-- Logs begin at Wed 2022-06-22 09:19:30 UTC, end at Wed 2022-06-22 10:44:53 UTC. -- Jun 22 10:09:28.444066 dv-cinder-843277-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 10:09:28.454636 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 10:09:28.455895 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 10:09:28 2022] *** Jun 22 10:09:28.455895 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 10:09:28.455895 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 10:09:28.455895 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: nodename: dv-cinder-843277-5-iscsi Jun 22 10:09:28.455895 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: machine: x86_64 Jun 22 10:09:28.455895 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: clock source: unix Jun 22 10:09:28.455895 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: pcre jit disabled Jun 22 10:09:28.455895 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: detected number of CPU cores: 4 Jun 22 10:09:28.455895 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: current working directory: / Jun 22 10:09:28.455895 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: detected binary path: /usr/bin/uwsgi-core Jun 22 10:09:28.456504 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: your processes number limit is 47680 Jun 22 10:09:28.456504 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: your memory page size is 4096 bytes Jun 22 10:09:28.456504 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: detected max file descriptor number: 2048 Jun 22 10:09:28.456504 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: lock engine: pthread robust mutexes Jun 22 10:09:28.456504 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: thunder lock: enabled Jun 22 10:09:28.456504 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 10:09:28.456504 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 10:09:28.509273 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: Python main interpreter initialized at 0x55dd5d5c89c0 Jun 22 10:09:28.509273 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: python threads support enabled Jun 22 10:09:28.509273 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: your server socket listen backlog is limited to 100 connections Jun 22 10:09:28.509273 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: your mercy for graceful operations on workers is 90 seconds Jun 22 10:09:28.509817 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 10:09:28.509817 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: *** Operational MODE: preforking *** Jun 22 10:09:28.510045 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: *** uWSGI is running in multiple interpreter mode *** Jun 22 10:09:28.510045 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: spawned uWSGI master process (pid: 103770) Jun 22 10:09:28.510193 dv-cinder-843277-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 10:09:28.511514 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: spawned uWSGI worker 1 (pid: 103771, cores: 1) Jun 22 10:09:28.511514 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: spawned uWSGI worker 2 (pid: 103772, cores: 1) Jun 22 10:09:28.511514 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 10:09:29.204970 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 10:09:29.219777 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 10:09:30.373649 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:09:30.373649 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: from cryptography.utils import int_from_bytes Jun 22 10:09:30.374385 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:09:30.374385 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: from cryptography.utils import int_from_bytes Jun 22 10:09:30.375239 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:09:30.375239 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: from cryptography.utils import int_from_bytes Jun 22 10:09:30.375659 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:09:30.375659 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: from cryptography.utils import int_from_bytes Jun 22 10:09:32.905878 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:09:32.906531 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:09:32.906630 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:09:32.906992 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:09:32.907250 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:09:32.907641 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.907915 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:09:32.908279 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.908369 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:09:32.908454 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.908583 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.908704 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:09:32.908938 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.909102 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:09:32.909253 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.909355 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:09:32.909573 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.909742 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.909893 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.910072 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.910222 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.910396 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.910488 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.910717 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.910810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.911050 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.911149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-5-iscsi {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.911372 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.911516 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.911696 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.911792 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.912006 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.912121 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.912326 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.912424 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.912589 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.912679 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.912928 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.913039 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.913258 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-5-iscsi {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.913348 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.913661 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.913755 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.913980 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.914205 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.914373 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.914552 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.914647 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.914853 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.914957 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.915202 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.915305 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.915518 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.915650 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.915867 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.916051 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.916222 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.916381 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.916590 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.916756 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.916958 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.917055 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.917135 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.917304 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.917486 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-5-iscsi {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.917623 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.917797 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.917939 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.918113 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.918266 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.918433 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.918564 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.918851 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.918938 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.919163 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.919260 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.919475 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.919567 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-5-iscsi {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.919796 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.919900 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.920121 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.920217 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.920431 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.920531 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.920760 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.920913 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.921107 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.921231 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.921421 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.921550 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.921748 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.921856 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.922053 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.922186 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.922363 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.922499 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.922675 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.922841 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.922996 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.923168 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.923304 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.923491 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.923614 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.923815 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.923907 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.924119 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.924219 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.924432 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.924532 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.924745 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.924859 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.925097 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.925199 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.925367 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.925454 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.925620 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.925788 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.925939 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.926034 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.926249 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.926336 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.926556 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.926656 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.926866 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.926960 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.927174 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.927259 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.927435 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.927533 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.927690 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.927777 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.928022 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.928142 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.928345 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.928445 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.928655 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.928743 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.928992 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.929091 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.929304 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.929398 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.929614 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.929701 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.929925 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.930018 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.930768 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.930856 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.931082 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.931236 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.931390 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.931488 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.931714 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.931805 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.932034 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.932131 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.932360 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.932456 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.932672 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.932767 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.933020 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.933122 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.933356 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.933499 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.933916 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.934008 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.934223 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.934308 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.934531 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.934635 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.934851 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.934937 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.935174 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.935266 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.935480 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.935573 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.935733 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.935872 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.936037 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.936132 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.936343 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.936437 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.936660 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.936746 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.936993 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.937081 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.937302 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.937397 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.937610 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.937696 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.937894 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.937977 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.938201 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.938288 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.938504 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.938589 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.938810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.938905 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.939118 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.939231 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.939425 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.939567 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.939730 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.939817 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.940032 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.940128 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.940337 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.940423 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.940640 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.940745 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.940969 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.941058 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.941279 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.941377 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.941584 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.941719 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.941889 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.941976 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.942196 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.942299 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.942501 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.942601 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.942821 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.942897 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.943128 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.943203 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.943435 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.943588 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.943757 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.943832 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.944062 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.944145 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.944367 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.944449 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.944675 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.944756 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.945010 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.945087 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.945319 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.945413 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.945629 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.945704 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.946508 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.946585 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.946819 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.946909 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.947219 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.947487 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.947487 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.947621 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.947729 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.947887 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.948952 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.949078 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.949168 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.949235 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.949300 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.949300 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.949450 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.949517 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.949772 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.949845 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.949918 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.949989 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.950156 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.950223 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.950399 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.950604 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.950922 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.950996 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.951234 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.951430 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.951542 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.951841 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.951989 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.952158 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.952244 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.952474 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.952558 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.952791 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.952934 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.953125 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.953216 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.953488 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.953588 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.953789 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.953873 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.954106 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.954197 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.954421 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.954506 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.954732 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.954819 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.955061 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:09:32.955154 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.955372 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.955457 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.955685 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.955770 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.955998 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.956078 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.956317 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.956410 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.956645 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.956804 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.956985 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.957122 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.957283 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.957436 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.957603 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.957689 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.957923 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.958025 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.958238 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.958391 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.958551 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.958647 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.958880 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.958972 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.959337 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.959446 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.959563 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.959648 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.959906 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.960003 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.960249 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.960345 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.960564 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.960649 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.960913 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.961006 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.961240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.961343 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.961582 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.961723 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.961896 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.962048 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.962192 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.962383 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.962511 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.962711 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.962847 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.963029 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.963161 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.963376 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.963460 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.963727 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.963811 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.964047 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.964146 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.964368 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.964452 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.964680 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.964772 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.965021 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.965122 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.965338 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.965429 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.965653 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.965737 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.965966 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.966050 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.966277 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.966361 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.966596 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.966681 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.966908 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.966995 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.967219 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.967303 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.967529 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.967612 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.967836 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.967929 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.968142 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.968226 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.968446 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.968538 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.968754 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.968929 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.969087 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.969172 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.969414 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.969532 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.969731 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.969827 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.970035 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.970119 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.970355 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.970448 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.970661 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.970744 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.970973 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.971083 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.971280 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.971375 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.971588 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.971682 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.971894 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.971980 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.972205 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.972302 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.972512 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.972597 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.972842 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.972980 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.973162 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.973265 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.973472 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.973555 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.973774 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.973864 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.974096 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.974182 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.974406 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.974491 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.974714 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.974799 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.975026 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.975119 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.975336 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.975427 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.975651 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.975735 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.975961 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.976045 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.976268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.976352 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.976589 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.976680 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.977513 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.977613 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.977760 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.977857 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.978088 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.978182 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.978399 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.978490 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.978713 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.978798 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.979031 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.979126 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.979345 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.979506 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.979662 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.979748 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.979968 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.980070 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.980281 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.980366 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.980585 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.980669 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.980913 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.981024 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.981222 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.981317 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.981533 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.981635 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.981839 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.981959 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.982147 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.982271 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.982453 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.982602 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.982759 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.982933 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.983065 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.983256 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.983389 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.983565 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.983700 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.983880 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.984006 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.984190 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.984311 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.984499 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.984618 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.984809 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.984998 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.985142 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.985306 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.985451 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.985651 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.985741 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.985989 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.986073 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.986310 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.986406 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.986636 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.986728 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.986956 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.987062 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.987260 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.987354 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.987573 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.987668 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.987876 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.987969 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.988208 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.988315 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.988620 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.988744 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.988861 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.988953 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.989183 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.989277 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.989506 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.989590 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.989818 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.989904 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.990152 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.990248 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.990454 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.990538 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.990772 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.990855 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.991076 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.991160 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.991391 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.991476 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.991708 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.991801 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.992025 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.992112 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.992349 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.992477 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.993225 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.993324 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.993546 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.993632 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.993861 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.993945 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.994171 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.994267 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.994486 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.994571 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.994798 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.994883 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.995106 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.995197 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.995423 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.995506 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.995736 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.995821 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.996057 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.996151 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.996370 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.996456 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.996694 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.996778 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.997034 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.997199 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.997355 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.997448 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.997659 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.997750 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.997972 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.998068 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.998287 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.998372 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.998607 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.998691 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.998917 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.999001 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.999233 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.999317 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.999554 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.999637 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.999866 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:32.999959 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.000180 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.000264 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.000493 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.000585 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.000801 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.000908 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.001127 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.001211 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.001441 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.001535 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.001755 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.001840 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.002068 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.002159 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.002381 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.002473 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.002689 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.002774 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.003006 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.003099 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.003317 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.003411 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.003625 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.003717 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.003930 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.004014 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.004239 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.004335 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.004550 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.004636 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.004886 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.004982 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.005208 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.005304 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.005525 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.005622 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.005829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.005913 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.006136 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.006222 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.006453 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.006537 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.006763 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.006857 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.007069 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.007154 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.007372 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.007456 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.007678 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.007761 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.008004 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.008087 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.008341 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.008422 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.008649 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.008741 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.008995 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.009082 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.009304 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.009389 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.009613 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.009749 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.009928 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.010012 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.010240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.010325 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.010547 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.010639 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.010857 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.010942 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.011166 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.011250 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.011475 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.011570 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.011790 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.011897 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.012102 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.012220 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.012415 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.012546 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.012734 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.012878 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.013081 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.013202 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.013391 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.013520 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.013703 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.013834 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.014015 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.014148 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.014320 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.014475 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.014632 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.014792 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.014955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.015103 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.015419 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.015533 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.015733 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.015870 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.016046 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.016188 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.016363 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.016510 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.016689 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.016900 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.017028 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.017226 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.017343 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.017558 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.017643 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.017891 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.017975 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.018235 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.018330 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.018544 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.018629 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.018857 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.019126 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.019212 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.019458 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.019548 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.019771 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.019854 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.020079 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.020163 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.020385 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.020471 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.020690 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.020780 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.021027 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.021114 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.021333 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.021419 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.021635 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.021728 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.021939 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.022108 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.022246 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.022343 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.022560 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.022652 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.022868 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.022964 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.023178 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.023272 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.023482 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.023567 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.023788 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.023882 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.024119 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.024215 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.024423 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.024506 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.024726 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.024835 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.025057 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.025142 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.025369 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.025462 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.025680 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.025775 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.025998 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.026083 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.026309 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.026393 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.026624 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.026718 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.026935 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.027027 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.027246 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.027329 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.027564 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.027656 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.027868 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.027952 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.028174 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.028265 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.028480 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.028573 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.028790 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.028901 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.029124 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.029219 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.029430 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.029524 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.029744 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.029839 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.030054 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.030187 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.030364 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.030484 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.030671 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.030798 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.030975 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.031110 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.031283 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.031420 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.031586 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.031731 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.031901 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.032041 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.032210 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.032356 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.032516 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.032691 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.032974 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.033126 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.033223 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.033302 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.033446 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.033613 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.033750 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.033927 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.034059 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.034240 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.034365 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.034549 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.034681 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.034860 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.034990 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.035168 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.035296 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.035487 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.035602 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.035799 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.035915 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.036106 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.036223 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.036415 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.036527 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.036730 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.036872 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.037065 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.037188 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.037374 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.037495 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.037686 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.037804 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.037994 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.038116 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.038320 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.038413 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.038632 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.038717 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.038941 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.039027 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.039267 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.040039 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.040138 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.040206 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.040388 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.040542 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.040697 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.040799 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.041049 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.041136 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.041393 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.041496 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.041673 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.041770 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.041982 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.042065 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.042289 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.042382 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.042596 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.042682 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.042901 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.042986 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.043209 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.043293 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.043517 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.043602 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.043840 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.043923 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.044149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.044232 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.044458 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.044543 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.044768 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.044919 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.045103 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.045196 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.045426 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.045519 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.045739 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.045824 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.046049 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.046142 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.046360 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.046446 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.046668 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.046760 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.046977 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.047077 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.047281 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.047373 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.047592 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.047677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.047906 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.047998 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.048210 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.048295 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.048516 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.048599 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.048840 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.048940 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.049159 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.049244 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.049466 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.049552 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.049769 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.049862 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.050091 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.050176 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.050403 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.050487 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.050715 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.050803 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.051055 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.051192 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.051372 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.051459 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.051691 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.051776 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.052001 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.052086 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.052309 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.052392 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.052621 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.052716 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.052951 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.053042 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.053269 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.053409 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.053573 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.053695 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.053885 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.053997 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.054197 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.054297 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.054508 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.054593 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.054820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.054906 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.055181 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.055768 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.055989 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.056074 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.056300 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.056394 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.056608 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.056708 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.056940 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.057036 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.057250 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.057349 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.057564 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.057650 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.057872 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.057959 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.058183 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.058268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.058492 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.058617 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.059057 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.059176 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.059364 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.059466 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.059677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.059796 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.059991 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.060109 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.060300 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.060422 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.060615 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.060731 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.061032 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.061168 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.061353 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.061488 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.061666 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.061803 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.061973 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.062063 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.062275 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.062369 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.062663 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.062748 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.062983 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.063078 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.063291 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.063423 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.063601 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.063728 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.063909 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.064047 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.064215 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.064364 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.064528 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.064675 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.064879 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.065018 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.065189 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.065333 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.065498 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.065653 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.065804 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.065970 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.066125 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.066281 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.066430 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.066700 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.066786 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.067021 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.067151 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.067334 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.067463 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.067649 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.067768 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.067959 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.068190 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.068345 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.068499 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.068594 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.068889 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.069003 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.069153 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.069239 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.069475 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.069561 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.069797 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.069895 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.070102 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.070196 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.070418 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.070515 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.070745 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.070847 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.071069 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.071188 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.071395 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.071503 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.071707 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.071822 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.072021 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.072207 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.072309 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.072526 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.072613 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.072858 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.072949 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.073190 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.073324 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.073517 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.073604 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.073846 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.074022 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.074178 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.074349 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.074494 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.074663 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.074808 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.074982 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.075136 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.075309 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.075462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.075619 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.075778 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.075931 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.076099 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.076242 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.076406 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.076549 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.076731 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.076872 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.077088 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.077188 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.077407 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.077527 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.077729 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.077817 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.078078 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.078164 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.078387 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.078479 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.078691 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.078777 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.078996 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.079081 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.079324 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.079446 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.079622 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.079709 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.079947 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.080260 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.080349 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.080584 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.080671 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.080933 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.081030 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.081238 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.081342 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.081560 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.081649 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.081869 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.081954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.082174 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.082269 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.082481 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.082565 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.082787 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.082909 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.083097 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.083223 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.083418 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.083526 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.083725 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.083812 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.084053 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.084149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.084370 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.084464 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.084680 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.084764 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.085038 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.085137 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.085363 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.085449 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.085681 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.085772 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.086002 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.086089 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.086350 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.086438 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.086661 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.086751 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.086966 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.087052 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.087276 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.087362 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.087582 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.087668 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.087885 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.087971 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.088189 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.088314 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.088496 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.088595 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.088801 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.088910 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.089125 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.089210 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.089429 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.089527 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.089751 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.089838 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.090056 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.090143 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.090376 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.090474 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.090684 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.090776 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.090988 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.091073 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.091292 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.091421 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.091596 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.091682 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.091935 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.092020 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.092238 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.092325 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.092571 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.092657 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.092903 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.092992 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.093213 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.093315 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.093522 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.093615 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.093841 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.093928 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.094148 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.094233 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.094471 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.094554 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.094783 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.094867 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.095094 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.095180 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.095404 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.095491 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.095712 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.095806 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.096031 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.096114 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.096345 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.096430 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.096754 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.096874 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.096992 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.097068 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.097306 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.097381 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.097624 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.097719 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.097949 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.098219 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.098318 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.098498 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.098599 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.098816 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.098907 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.099128 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.099222 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.099440 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.099538 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.099755 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.099849 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.100069 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.100154 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.100380 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.100481 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.100690 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.100784 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.101026 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.101122 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.101416 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.101532 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.101658 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.101894 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.102493 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.102726 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.102813 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.103059 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.103154 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.103378 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.103511 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.103697 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.103792 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.104015 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.104108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.104333 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.104427 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.104652 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.104747 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.104994 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.105084 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.105311 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.105396 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.105625 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.105711 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.105938 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.106023 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.106253 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.106342 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.106567 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.106656 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.106881 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.106973 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.107197 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.107292 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.107511 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.107604 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.107823 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.107916 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.108133 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.108227 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.108448 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.108533 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.108761 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.108915 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.109114 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.109208 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.109441 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.109526 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.109759 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.109844 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.110071 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.110156 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.110387 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.110471 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.110698 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.110786 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.111013 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.111217 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.111332 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.111540 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.111647 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.111879 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.111972 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.112211 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.112303 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.112540 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.112627 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.112889 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.112989 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.113214 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.113299 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.113546 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.113631 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.113859 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.113999 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.114168 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.114263 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.114483 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.114569 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.114794 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.114878 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.115102 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.115311 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.115426 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.115628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.115727 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.115965 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.116051 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.116294 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.116388 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.116623 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.116710 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.116967 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.117189 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.117275 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.118350 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.118469 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.118469 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.118624 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.118749 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.118837 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.119069 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.119168 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.119383 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.119476 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.119694 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.119781 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.120018 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.120116 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.120331 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.120417 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.120637 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.120721 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.120978 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.121109 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.121289 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.121374 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.121596 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.121827 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.121977 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.122179 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.122270 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.122501 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.122587 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.122806 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.122901 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.123117 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.123210 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.123424 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.123510 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.123754 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.123848 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.124061 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.124146 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.124366 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.124458 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.124672 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.124758 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.125010 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.125098 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.125319 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.125404 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.125626 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.125711 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.125937 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.126033 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.126240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.126348 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.126566 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.126682 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.126855 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.126951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.127164 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.127290 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.127468 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.127584 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.127780 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.127885 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.128085 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.128256 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.128393 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.128575 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.128748 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.128921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.129099 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.129241 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.129406 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.129552 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.129711 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.129860 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.130027 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.130171 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.130340 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.130479 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.130663 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.130794 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.130974 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.131103 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.131288 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.131412 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.131634 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.131726 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.131951 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.132044 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.132313 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.132479 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.132624 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.132861 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.133012 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.133157 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.133365 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.133516 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.133676 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.133849 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.133986 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.134160 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.134304 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.134469 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.134618 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.134774 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.134948 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.135100 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.135264 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.135411 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.135581 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.135724 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.135933 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.136036 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.136254 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.136340 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.136652 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.136838 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.136988 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.137143 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.137297 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.137470 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.137607 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.137809 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.137918 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.138146 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.138233 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.138458 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.138552 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.138767 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.138853 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.139080 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.139165 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.139408 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.139502 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.139725 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.139811 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.140038 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.140124 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.140352 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.140449 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.140667 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.140751 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.141005 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.141108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.141313 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.141407 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.141623 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.141753 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.141932 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.142016 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.142243 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.142329 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.142551 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.142635 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.142863 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.142952 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.143173 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.143260 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.143476 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.143559 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.143790 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.143918 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.144136 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.144265 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.144459 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.144546 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.144779 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.144901 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.145123 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.145219 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.145442 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.145528 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.145757 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.145855 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.146066 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.146150 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.146377 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.146462 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.146688 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.146779 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.147005 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.147097 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.147339 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.147423 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.147652 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.147737 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.147960 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.148047 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.148274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.148388 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.148579 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.148707 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.148938 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.149079 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.149251 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.149406 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.149572 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.149720 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.149884 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.150045 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.150189 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.150389 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.150476 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.150785 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.150870 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.151086 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.151175 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.151388 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.151671 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.151797 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.151982 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.152291 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.152376 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.152595 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.152927 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.153016 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.153232 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.153401 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.153536 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.153842 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.153996 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.154145 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.154453 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.154570 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.154757 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.155058 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.155143 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.155362 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.155668 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.155760 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.155970 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.156054 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.156304 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.156389 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.156636 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.156777 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.157066 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.157370 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.157502 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.157817 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.157940 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.166691 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.166799 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.166873 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.166955 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.167035 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.167113 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.167201 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.167269 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.167361 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.167440 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.167523 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.167602 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.167716 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.167868 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.167962 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.168058 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.168157 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.168240 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.168334 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.168416 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.168495 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.168573 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.168651 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.168728 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.168869 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.168869 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169029 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169111 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169187 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169268 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169335 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169399 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169471 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169552 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169630 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169717 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169785 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169850 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169914 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.169978 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.170049 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.170125 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.170199 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.170272 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.170338 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.170416 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.170503 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.170590 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.170671 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.170750 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.170828 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.170914 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.171003 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.171084 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.171163 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.171242 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.171326 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.171413 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.171568 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.171651 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.171738 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.171825 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.171905 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.171980 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.172047 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.172112 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.172202 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.172282 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.172420 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.172523 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.172612 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.172692 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.172770 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.172865 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.172958 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173048 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173124 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173203 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173281 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173359 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173437 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173523 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:09:33.173612 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173612 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173612 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173612 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173612 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173612 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173612 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.173612 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.174141 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.174214 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.174533 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.174857 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.175193 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.175526 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.175843 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.176176 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.176512 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.176896 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.177222 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.177574 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.177918 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.178234 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.178553 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.178864 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:09:33.179117 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:09:33.243509 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO dbcounter [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] Registered counter for database nova_api Jun 22 10:09:33.324727 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO dbcounter [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Registered counter for database nova_api Jun 22 10:09:33.346646 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_db.sqlalchemy.engines [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:09:33.353840 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writer thread running {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:09:33.354029 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG oslo_db.sqlalchemy.engines [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:09:33.360389 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG dbcounter [-] [103771] Writer thread running {{(pid=103771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:09:33.411124 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.context [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6(cell1) {{(pid=103772) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 10:09:33.415767 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:09:33.417007 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.context [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6(cell1) {{(pid=103771) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 10:09:33.417292 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:09:33.418085 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:09:33.420033 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:09:33.420923 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG oslo_concurrency.lockutils [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:09:33.422065 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO dbcounter [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Registered counter for database nova_cell0 Jun 22 10:09:33.422527 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG oslo_concurrency.lockutils [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:09:33.423327 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG oslo_concurrency.lockutils [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:09:33.425430 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG oslo_concurrency.lockutils [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:09:33.426077 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO dbcounter [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Registered counter for database nova_cell1 Jun 22 10:09:33.427408 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO dbcounter [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] Registered counter for database nova_cell0 Jun 22 10:09:33.431341 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO dbcounter [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] Registered counter for database nova_cell1 Jun 22 10:09:33.434565 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_db.sqlalchemy.engines [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:09:33.435812 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_db.sqlalchemy.engines [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:09:33.439095 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG oslo_db.sqlalchemy.engines [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:09:33.440912 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writer thread running {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:09:33.441310 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG oslo_db.sqlalchemy.engines [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:09:33.446381 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG dbcounter [-] [103771] Writer thread running {{(pid=103771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:09:33.449852 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG dbcounter [-] [103771] Writer thread running {{(pid=103771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:09:33.581719 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writer thread running {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:09:33.591234 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO dbcounter [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Registered counter for database nova_cell0 Jun 22 10:09:33.598332 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO dbcounter [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] Registered counter for database nova_cell0 Jun 22 10:09:33.599782 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_db.sqlalchemy.engines [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:09:33.605214 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writer thread running {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:09:33.607610 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG oslo_db.sqlalchemy.engines [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:09:33.611949 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG dbcounter [-] [103771] Writer thread running {{(pid=103771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:09:34.024602 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: WARNING keystonemiddleware.auth_token [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:09:34.031963 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: WARNING keystonemiddleware.auth_token [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:09:34.037657 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: WARNING keystonemiddleware.auth_token [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:09:34.045603 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: WARNING keystonemiddleware.auth_token [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:09:34.372413 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: WARNING keystonemiddleware.auth_token [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:09:34.378524 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: WARNING keystonemiddleware.auth_token [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:09:34.383866 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dd5d5c89c0 pid: 103772 (default app) Jun 22 10:09:34.386001 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:34.386168 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: WARNING keystonemiddleware.auth_token [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:09:34.387226 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001798 Jun 22 10:09:34.387640 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Wed Jun 22 10:09:34 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:09:34.392390 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: WARNING keystonemiddleware.auth_token [None req-90aa3a19-e164-4e3d-9f30-5bd6d7022d3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:09:34.397676 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dd5d5c89c0 pid: 103771 (default app) Jun 22 10:10:54.737693 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:10:54.738689 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jun 22 10:10:54.739117 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:10:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:10:54.751533 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG dbcounter [-] [103771] Writing DB stats nova_api:SELECT=3 {{(pid=103771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:54.753187 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG dbcounter [-] [103771] Writing DB stats nova_cell0:SELECT=3 {{(pid=103771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:54.754233 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG dbcounter [-] [103771] Writing DB stats nova_cell1:SELECT=3 {{(pid=103771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:54.755545 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG dbcounter [-] [103771] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:55.191040 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-e5205462-3e5f-4dd9-a747-a8c43c486c26 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:10:55.222816 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-e5205462-3e5f-4dd9-a747-a8c43c486c26 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476704 Jun 22 10:10:55.224921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Wed Jun 22 10:10:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:10:57.348536 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:10:57.350189 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-69ac0320-942a-45d7-a1ee-75651bab9d22 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Jun 22 10:10:57.350579 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:10:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:10:57.413709 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-2caa11ce-7e9a-411c-bf7f-30538ceaa8d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:10:57.432941 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:10:57.432941 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: warnings.warn(msg) Jun 22 10:10:57.528658 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-2caa11ce-7e9a-411c-bf7f-30538ceaa8d4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.171810 Jun 22 10:10:57.529383 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jun 22 10:10:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:10:57.757666 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-f3c9fc26-53e1-4e16-92d6-0b27b8f092f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:10:57.760007 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:10:57.760007 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: warnings.warn(msg) Jun 22 10:10:57.779532 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writing DB stats nova_api:SELECT=3 {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:57.780423 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writing DB stats nova_cell1:SELECT=3 {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:57.781243 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writing DB stats nova_cell0:SELECT=3 {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:57.781963 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:57.896272 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-f3c9fc26-53e1-4e16-92d6-0b27b8f092f9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.357732 Jun 22 10:10:57.897136 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jun 22 10:10:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:11:00.014156 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-2caa11ce-7e9a-411c-bf7f-30538ceaa8d4 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:00.015165 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-2caa11ce-7e9a-411c-bf7f-30538ceaa8d4 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 22 10:11:00.015565 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:11:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:00.121226 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-b96af3c4-5dae-4d19-8245-20b0313da22e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "swap": 0, "ram": 512, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:00.138518 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:11:00.138518 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: warnings.warn(msg) Jun 22 10:11:00.233253 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-b96af3c4-5dae-4d19-8245-20b0313da22e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.211535 Jun 22 10:11:00.233974 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jun 22 10:11:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:00.246042 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-ca6af56e-cfc7-457c-b769-96f702fff308 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:00.247517 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:11:00.247517 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: warnings.warn(msg) Jun 22 10:11:00.448120 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-ca6af56e-cfc7-457c-b769-96f702fff308 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.205557 Jun 22 10:11:00.448647 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jun 22 10:11:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:11:02.582283 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-b96af3c4-5dae-4d19-8245-20b0313da22e admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:02.583862 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-b96af3c4-5dae-4d19-8245-20b0313da22e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002019 Jun 22 10:11:02.584257 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:11:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:02.647484 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-440d63c3-3ff4-4cd7-a2bb-fcf9e5a7126c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "ram": 1024, "name": "ds1G"}} {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:02.732612 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-440d63c3-3ff4-4cd7-a2bb-fcf9e5a7126c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142174 Jun 22 10:11:02.733228 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jun 22 10:11:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:02.745623 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-0666d0e2-9209-41f8-95c6-2ac5b61f988e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:02.820452 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-0666d0e2-9209-41f8-95c6-2ac5b61f988e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078576 Jun 22 10:11:02.832853 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jun 22 10:11:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:11:05.091357 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-440d63c3-3ff4-4cd7-a2bb-fcf9e5a7126c admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:05.092365 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-440d63c3-3ff4-4cd7-a2bb-fcf9e5a7126c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 22 10:11:05.092956 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:11:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:05.158034 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-19de7549-0a21-4116-82ea-e02490ad9bfb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "id": "d3"}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:05.231364 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-19de7549-0a21-4116-82ea-e02490ad9bfb admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132189 Jun 22 10:11:05.231917 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jun 22 10:11:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:05.244426 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-ecc9673e-9472-4f60-8de8-e84e98771fb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:05.334696 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-ecc9673e-9472-4f60-8de8-e84e98771fb2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094022 Jun 22 10:11:05.335416 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jun 22 10:11:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:11:07.448071 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-19de7549-0a21-4116-82ea-e02490ad9bfb admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:07.449144 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-19de7549-0a21-4116-82ea-e02490ad9bfb admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jun 22 10:11:07.449851 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:11:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:07.521355 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-c140d527-39cc-4940-a48d-c4e7112312ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "disk": 20, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:07.614846 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-c140d527-39cc-4940-a48d-c4e7112312ad admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156767 Jun 22 10:11:07.624076 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jun 22 10:11:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:07.634254 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-b95f086a-bb23-471d-b41f-8d1bde4ddf0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:07.730876 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-b95f086a-bb23-471d-b41f-8d1bde4ddf0e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104751 Jun 22 10:11:07.753032 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Wed Jun 22 10:11:07 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:11:09.867809 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-c140d527-39cc-4940-a48d-c4e7112312ad admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:09.869428 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-c140d527-39cc-4940-a48d-c4e7112312ad admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002039 Jun 22 10:11:09.869833 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:09.937354 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-7526dac3-1f19-4be2-961d-2b68ff76fb34 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:09.962371 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-7526dac3-1f19-4be2-961d-2b68ff76fb34 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086706 Jun 22 10:11:09.963439 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Wed Jun 22 10:11:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:11:12.182908 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-c140d527-39cc-4940-a48d-c4e7112312ad admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:12.183924 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-c140d527-39cc-4940-a48d-c4e7112312ad admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 22 10:11:12.184332 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:11:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:11:12.252102 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-27d27dc3-10c6-4c5a-9550-5e2a6ecf1524 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:12.330040 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-27d27dc3-10c6-4c5a-9550-5e2a6ecf1524 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.137472 Jun 22 10:11:12.330657 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jun 22 10:11:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:12.343545 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-44a5b489-94af-40fb-a345-5da50af50af4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:12.425490 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-44a5b489-94af-40fb-a345-5da50af50af4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085387 Jun 22 10:11:12.426245 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jun 22 10:11:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:11:14.673983 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-27d27dc3-10c6-4c5a-9550-5e2a6ecf1524 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:14.675049 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-27d27dc3-10c6-4c5a-9550-5e2a6ecf1524 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jun 22 10:11:14.675464 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:11:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:14.737270 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-2f358524-4d13-4682-8f5a-4e56e9aaf1de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "rxtx_factor": 1.0, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:14.833529 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-2f358524-4d13-4682-8f5a-4e56e9aaf1de admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.150775 Jun 22 10:11:14.834089 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jun 22 10:11:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:14.846387 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-15510595-8493-40a5-ab62-17e097605a7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:14.932718 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-15510595-8493-40a5-ab62-17e097605a7e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090210 Jun 22 10:11:14.933547 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jun 22 10:11:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:11:17.084495 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-2f358524-4d13-4682-8f5a-4e56e9aaf1de admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:17.085815 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-2f358524-4d13-4682-8f5a-4e56e9aaf1de admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 Jun 22 10:11:17.086359 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:11:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:17.150340 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-d5862236-f654-4649-8b50-1de57ff4a913 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:17.332342 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-d5862236-f654-4649-8b50-1de57ff4a913 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.238172 Jun 22 10:11:17.334065 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jun 22 10:11:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:17.345739 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-3bf0aac6-0200-4f7d-88cf-808f40854db4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:17.419846 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-3bf0aac6-0200-4f7d-88cf-808f40854db4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077842 Jun 22 10:11:17.420425 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jun 22 10:11:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:11:19.522554 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-d5862236-f654-4649-8b50-1de57ff4a913 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:19.523627 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-d5862236-f654-4649-8b50-1de57ff4a913 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Jun 22 10:11:19.524126 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:11:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:19.582722 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-a16ebcf5-ff79-4bc5-8045-266417de70da admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:19.655622 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-a16ebcf5-ff79-4bc5-8045-266417de70da admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.125117 Jun 22 10:11:19.656270 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jun 22 10:11:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:11:19.668565 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-0ec8c447-8cb6-4617-a267-8dc2bddf05da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:19.831586 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-0ec8c447-8cb6-4617-a267-8dc2bddf05da admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.166937 Jun 22 10:11:19.874014 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jun 22 10:11:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:11:21.977059 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-a16ebcf5-ff79-4bc5-8045-266417de70da admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:21.978089 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-a16ebcf5-ff79-4bc5-8045-266417de70da admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 22 10:11:21.978482 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:11:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:22.041588 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-3712baff-8fae-49bd-b7a0-c649bc9caae9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:22.137399 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-3712baff-8fae-49bd-b7a0-c649bc9caae9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.153071 Jun 22 10:11:22.145594 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Wed Jun 22 10:11:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:22.150226 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-e25a5230-6119-4723-bf0a-8b6797f3901c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:22.231165 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-e25a5230-6119-4723-bf0a-8b6797f3901c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084620 Jun 22 10:11:22.232449 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Wed Jun 22 10:11:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:11:47.741851 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-3712baff-8fae-49bd-b7a0-c649bc9caae9 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:47.742856 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-3712baff-8fae-49bd-b7a0-c649bc9caae9 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 22 10:11:47.743253 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:11:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:47.753782 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG dbcounter [-] [103771] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:47.803189 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-0ef8ff1a-59c0-454b-be3e-ed7867b7a5de admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:47.820567 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-0ef8ff1a-59c0-454b-be3e-ed7867b7a5de admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071369 Jun 22 10:11:47.821134 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Wed Jun 22 10:11:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:11:48.765076 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-3712baff-8fae-49bd-b7a0-c649bc9caae9 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:48.766142 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-3712baff-8fae-49bd-b7a0-c649bc9caae9 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jun 22 10:11:48.766537 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jun 22 10:11:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:48.974763 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-174f9424-65aa-4eac-8dd1-5a9dc7f57486 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:48.980627 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.wsgi [None req-174f9424-65aa-4eac-8dd1-5a9dc7f57486 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-174f9424-65aa-4eac-8dd1-5a9dc7f57486 admin admin] Request method failure captured: Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Accept: application/json Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Accept-Encoding: gzip, deflate Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Connection: keep-alive Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Content-Length: 0 Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Host: 10.222.0.46 Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Openstack-Api-Version: compute 2.90 Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Openstack-System-Scope: None Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: User-Agent: python-novaclient Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Auth-Token: gAAAAABisurkL9YS5TjpNUE56qDysiah2hEpac25MQW8_NCsUtm-HxOEmuFDgCy9oPS76zR1ua8NXIbDz0nEJM6ryRMSM0P8Gf_Hg0uRwK3ktT0jnsLnAnT7EtteV0j6FRKe14uDGFE9j74DW32LLP9UHDiPYlp4HYLKOf8ZBH8Zq1zdXHbuhyU Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Domain-Id: None Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Domain-Name: None Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Identity-Status: Confirmed Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Is-Admin-Project: True Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Project-Domain-Id: default Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Project-Domain-Name: Default Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Project-Id: 40e8688682434d2c9756b8751cda6e48 Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Project-Name: admin Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Role: member,reader,admin Jun 22 10:11:48.983954 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Roles: member,reader,admin Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_40e8688682434d2c9756b8751cda6e48", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Tenant: admin Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Tenant-Id: 40e8688682434d2c9756b8751cda6e48 Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Tenant-Name: admin Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User: admin Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User-Domain-Id: default Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User-Domain-Name: Default Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User-Id: af7691de913843509188548c36ece976 Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User-Name: admin Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: method: > Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: exception: Flavor 42 could not be found. Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: action_args: {'id': '42'} Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:11:48.985462 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:11:48.989288 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:48.990628 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-174f9424-65aa-4eac-8dd1-5a9dc7f57486 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:11:48.991760 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-174f9424-65aa-4eac-8dd1-5a9dc7f57486 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.067263 Jun 22 10:11:48.991760 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Jun 22 10:11:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:48.995647 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-d6119eb0-6a84-4529-a8d0-9b78416a3b25 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:48.998589 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:11:49.017165 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-d6119eb0-6a84-4529-a8d0-9b78416a3b25 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025033 Jun 22 10:11:49.017694 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jun 22 10:11:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:11:49.027795 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-ad236cf6-6b61-47ff-a759-a99dcc057aac admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:49.049176 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-ad236cf6-6b61-47ff-a759-a99dcc057aac admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025244 Jun 22 10:11:49.050515 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jun 22 10:11:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:11:49.059953 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-e4851a23-73e3-4873-83aa-aeb58e4ddd7f admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:49.066012 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.wsgi [None req-e4851a23-73e3-4873-83aa-aeb58e4ddd7f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-e4851a23-73e3-4873-83aa-aeb58e4ddd7f admin admin] Request method failure captured: Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Accept: application/json Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Accept-Encoding: gzip, deflate Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Connection: keep-alive Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Content-Length: 0 Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Host: 10.222.0.46 Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Openstack-Api-Version: compute 2.90 Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Openstack-System-Scope: None Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: User-Agent: python-novaclient Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Auth-Token: gAAAAABisurkL9YS5TjpNUE56qDysiah2hEpac25MQW8_NCsUtm-HxOEmuFDgCy9oPS76zR1ua8NXIbDz0nEJM6ryRMSM0P8Gf_Hg0uRwK3ktT0jnsLnAnT7EtteV0j6FRKe14uDGFE9j74DW32LLP9UHDiPYlp4HYLKOf8ZBH8Zq1zdXHbuhyU Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Domain-Id: None Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Domain-Name: None Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Identity-Status: Confirmed Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Is-Admin-Project: True Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Project-Domain-Id: default Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Project-Domain-Name: Default Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Project-Id: 40e8688682434d2c9756b8751cda6e48 Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Project-Name: admin Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Role: member,reader,admin Jun 22 10:11:49.069274 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Roles: member,reader,admin Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_40e8688682434d2c9756b8751cda6e48", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Tenant: admin Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Tenant-Id: 40e8688682434d2c9756b8751cda6e48 Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Tenant-Name: admin Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User: admin Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User-Domain-Id: default Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User-Domain-Name: Default Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User-Id: af7691de913843509188548c36ece976 Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User-Name: admin Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: method: > Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: exception: Flavor 42 could not be found. Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: action_args: {'id': '42'} Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:11:49.078149 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:11:49.079108 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:49.080307 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-e4851a23-73e3-4873-83aa-aeb58e4ddd7f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:11:49.082191 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-e4851a23-73e3-4873-83aa-aeb58e4ddd7f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014334 Jun 22 10:11:49.082191 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Jun 22 10:11:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:49.897564 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-ad236cf6-6b61-47ff-a759-a99dcc057aac admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:49.898580 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-ad236cf6-6b61-47ff-a759-a99dcc057aac admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005857 Jun 22 10:11:49.898988 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jun 22 10:11:49 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:50.094320 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-6b016f50-5927-4e9f-94f1-6dfe10e10c2a admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:50.100661 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.wsgi [None req-6b016f50-5927-4e9f-94f1-6dfe10e10c2a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-6b016f50-5927-4e9f-94f1-6dfe10e10c2a admin admin] Request method failure captured: Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Accept: application/json Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Accept-Encoding: gzip, deflate Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Connection: keep-alive Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Content-Length: 0 Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Host: 10.222.0.46 Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Openstack-Api-Version: compute 2.90 Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Openstack-System-Scope: None Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: User-Agent: python-novaclient Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Auth-Token: gAAAAABisurlWUpaD79rDCgmQdowqLksKfVp5swyN_6zZ9Zwedrrj5RYt8sLopm_5034jbnlMN2Tpy0lZO4sJ3Yv4MJNWEVJh5GBgXMaNv1vHA11XvmZLM8waHCSrAYzsWCFC5AZnBFpH0W1TB40CntiBWsVDWtrmZwaslVejXZbEIjs5T4ICBA Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Domain-Id: None Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Domain-Name: None Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Identity-Status: Confirmed Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Is-Admin-Project: True Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Project-Domain-Id: default Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Project-Domain-Name: Default Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Project-Id: 40e8688682434d2c9756b8751cda6e48 Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Project-Name: admin Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Role: member,reader,admin Jun 22 10:11:50.102204 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Roles: member,reader,admin Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_40e8688682434d2c9756b8751cda6e48", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Tenant: admin Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Tenant-Id: 40e8688682434d2c9756b8751cda6e48 Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Tenant-Name: admin Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User: admin Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User-Domain-Id: default Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User-Domain-Name: Default Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User-Id: af7691de913843509188548c36ece976 Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User-Name: admin Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: method: > Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: exception: Flavor 84 could not be found. Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: action_args: {'id': '84'} Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:11:50.103820 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:11:50.104810 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:50.106346 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-6b016f50-5927-4e9f-94f1-6dfe10e10c2a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:11:50.107599 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-6b016f50-5927-4e9f-94f1-6dfe10e10c2a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061291 Jun 22 10:11:50.107599 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Jun 22 10:11:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:50.113268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-ef6fd354-2de0-4e74-bbbf-b67f4f71a75c admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:50.126710 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-ef6fd354-2de0-4e74-bbbf-b67f4f71a75c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017037 Jun 22 10:11:50.127236 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jun 22 10:11:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:11:50.136662 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-5ac1e162-a25d-4eeb-bc69-a39652ab469d admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:50.152485 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-5ac1e162-a25d-4eeb-bc69-a39652ab469d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019382 Jun 22 10:11:50.153041 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jun 22 10:11:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:11:50.162886 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-919adef2-73af-45bc-9adb-a1aca2b84d7b admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:50.168257 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.wsgi [None req-919adef2-73af-45bc-9adb-a1aca2b84d7b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-919adef2-73af-45bc-9adb-a1aca2b84d7b admin admin] Request method failure captured: Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Accept: application/json Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Accept-Encoding: gzip, deflate Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Connection: keep-alive Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Content-Length: 0 Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Host: 10.222.0.46 Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Openstack-Api-Version: compute 2.90 Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Openstack-System-Scope: None Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: User-Agent: python-novaclient Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Auth-Token: gAAAAABisurlWUpaD79rDCgmQdowqLksKfVp5swyN_6zZ9Zwedrrj5RYt8sLopm_5034jbnlMN2Tpy0lZO4sJ3Yv4MJNWEVJh5GBgXMaNv1vHA11XvmZLM8waHCSrAYzsWCFC5AZnBFpH0W1TB40CntiBWsVDWtrmZwaslVejXZbEIjs5T4ICBA Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Domain-Id: None Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Domain-Name: None Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Identity-Status: Confirmed Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Is-Admin-Project: True Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Project-Domain-Id: default Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Project-Domain-Name: Default Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Project-Id: 40e8688682434d2c9756b8751cda6e48 Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Project-Name: admin Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Role: member,reader,admin Jun 22 10:11:50.169773 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Roles: member,reader,admin Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_40e8688682434d2c9756b8751cda6e48", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Tenant: admin Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Tenant-Id: 40e8688682434d2c9756b8751cda6e48 Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Tenant-Name: admin Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User: admin Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User-Domain-Id: default Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User-Domain-Name: Default Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User-Id: af7691de913843509188548c36ece976 Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User-Name: admin Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: method: > Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: exception: Flavor 84 could not be found. Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: action_args: {'id': '84'} Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:11:50.171268 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:11:50.172224 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:50.173921 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-919adef2-73af-45bc-9adb-a1aca2b84d7b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:11:50.175469 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-919adef2-73af-45bc-9adb-a1aca2b84d7b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012346 Jun 22 10:11:50.175469 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Wed Jun 22 10:11:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:51.011754 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-5ac1e162-a25d-4eeb-bc69-a39652ab469d admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:51.012788 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-5ac1e162-a25d-4eeb-bc69-a39652ab469d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 22 10:11:51.013240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jun 22 10:11:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:51.205859 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-da366307-f02a-4e2e-862c-b654d9d84b08 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.wsgi [None req-da366307-f02a-4e2e-862c-b654d9d84b08 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-da366307-f02a-4e2e-862c-b654d9d84b08 admin admin] Request method failure captured: Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Accept: application/json Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Accept-Encoding: gzip, deflate Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Connection: keep-alive Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Content-Length: 0 Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Host: 10.222.0.46 Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Openstack-Api-Version: compute 2.90 Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Openstack-System-Scope: None Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: User-Agent: python-novaclient Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Auth-Token: gAAAAABisurmgEE27wrYmOB7fmutr2cou5e5pbDjSiFQc3FrJOmXkTLgZKZcZ5Gpnj7TzWctbYpZZOCgkXQavslM1TDj1FYltdzk3FaeiUFrKnUYpGj34CGS71AXVQFZuhhF-pZUCyLQ6Y7K-Dffu868S6tzoO_DDL3MvV0r28iZSrWXpOUM2MA Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Domain-Id: None Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Domain-Name: None Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Identity-Status: Confirmed Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Is-Admin-Project: True Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Project-Domain-Id: default Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Project-Domain-Name: Default Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Project-Id: 40e8688682434d2c9756b8751cda6e48 Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Project-Name: admin Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Role: member,reader,admin Jun 22 10:11:51.216677 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Roles: member,reader,admin Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_40e8688682434d2c9756b8751cda6e48", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Tenant: admin Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Tenant-Id: 40e8688682434d2c9756b8751cda6e48 Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-Tenant-Name: admin Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User: admin Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User-Domain-Id: default Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User-Domain-Name: Default Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User-Id: af7691de913843509188548c36ece976 Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: X-User-Name: admin Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: method: > Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: exception: Flavor 451 could not be found. Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: action_args: {'id': '451'} Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:11:51.218135 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:11:51.218951 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: ERROR nova.api.openstack.wsgi Jun 22 10:11:51.220009 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-da366307-f02a-4e2e-862c-b654d9d84b08 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:11:51.221198 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-da366307-f02a-4e2e-862c-b654d9d84b08 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062859 Jun 22 10:11:51.221198 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jun 22 10:11:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:51.225785 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-d8055b10-f80c-48f4-a1af-74a7ce59d65a admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:51.240325 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-d8055b10-f80c-48f4-a1af-74a7ce59d65a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019400 Jun 22 10:11:51.240891 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jun 22 10:11:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:11:51.250735 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:51.269597 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022105 Jun 22 10:11:51.270169 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Wed Jun 22 10:11:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:11:51.279743 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-373fac4a-ed7e-4121-82e4-4cfd815b96f6 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:51.285846 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.wsgi [None req-373fac4a-ed7e-4121-82e4-4cfd815b96f6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-373fac4a-ed7e-4121-82e4-4cfd815b96f6 admin admin] Request method failure captured: Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Accept: application/json Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Accept-Encoding: gzip, deflate Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Connection: keep-alive Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Content-Length: 0 Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Host: 10.222.0.46 Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Openstack-Api-Version: compute 2.90 Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Openstack-System-Scope: None Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: User-Agent: python-novaclient Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Auth-Token: gAAAAABisurmgEE27wrYmOB7fmutr2cou5e5pbDjSiFQc3FrJOmXkTLgZKZcZ5Gpnj7TzWctbYpZZOCgkXQavslM1TDj1FYltdzk3FaeiUFrKnUYpGj34CGS71AXVQFZuhhF-pZUCyLQ6Y7K-Dffu868S6tzoO_DDL3MvV0r28iZSrWXpOUM2MA Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Domain-Id: None Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Domain-Name: None Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Identity-Status: Confirmed Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Is-Admin-Project: True Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Project-Domain-Id: default Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Project-Domain-Name: Default Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Project-Id: 40e8688682434d2c9756b8751cda6e48 Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Project-Name: admin Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Role: member,reader,admin Jun 22 10:11:51.287240 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Roles: member,reader,admin Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_40e8688682434d2c9756b8751cda6e48", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/40e8688682434d2c9756b8751cda6e48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Tenant: admin Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Tenant-Id: 40e8688682434d2c9756b8751cda6e48 Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-Tenant-Name: admin Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User: admin Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User-Domain-Id: default Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User-Domain-Name: Default Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User-Id: af7691de913843509188548c36ece976 Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: X-User-Name: admin Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: method: > Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: exception: Flavor 451 could not be found. Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: action_args: {'id': '451'} Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:11:51.288955 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:11:51.289829 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: ERROR nova.api.openstack.wsgi Jun 22 10:11:51.291070 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-373fac4a-ed7e-4121-82e4-4cfd815b96f6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:11:51.292258 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-373fac4a-ed7e-4121-82e4-4cfd815b96f6 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012450 Jun 22 10:11:51.292258 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jun 22 10:11:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:11:52.110423 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:52.111443 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 22 10:11:52.112344 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jun 22 10:11:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:52.302529 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-050d5f65-c92a-4248-b39c-ae262208e51a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:52.376060 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-050d5f65-c92a-4248-b39c-ae262208e51a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.126588 Jun 22 10:11:52.376633 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Jun 22 10:11:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:53.201905 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:53.202907 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 22 10:11:53.203301 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jun 22 10:11:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:53.398765 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-72fb750d-e5fc-42aa-8b93-056ce924264b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:53.472528 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-72fb750d-e5fc-42aa-8b93-056ce924264b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.126071 Jun 22 10:11:53.473005 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Jun 22 10:11:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:54.301461 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:54.302456 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 22 10:11:54.302854 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jun 22 10:11:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:54.495680 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-da0b67c8-7263-47b2-8423-8317bfa7f970 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:54.579235 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-da0b67c8-7263-47b2-8423-8317bfa7f970 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.136576 Jun 22 10:11:54.579786 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Jun 22 10:11:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:55.410700 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:55.411712 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jun 22 10:11:55.412125 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jun 22 10:11:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:55.601254 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-f2721ebb-b35a-42a4-80b3-ef6bd9db383f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:11:55.682903 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-f2721ebb-b35a-42a4-80b3-ef6bd9db383f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.134903 Jun 22 10:11:55.683444 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Wed Jun 22 10:11:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:11:56.508912 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:56.509913 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 22 10:11:56.510312 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jun 22 10:11:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:56.702214 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-2cb4cebd-c4df-4914-b099-682c366aee54 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:56.721331 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-2cb4cebd-c4df-4914-b099-682c366aee54 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072378 Jun 22 10:11:56.721857 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Wed Jun 22 10:11:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:12:43.737152 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:12:43.738160 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-d5263b59-eb46-465f-a74d-63382e0c82b3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 22 10:12:43.738558 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Wed Jun 22 10:12:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:12:43.748795 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:43.798702 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-751f10a1-9729-4c78-9061-aa6f387550a5 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:12:43.818076 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-751f10a1-9729-4c78-9061-aa6f387550a5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073735 Jun 22 10:12:43.818610 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Wed Jun 22 10:12:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:12:43.841960 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-799a9d85-c7e3-46a9-b279-1bac0e26745b admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:12:43.846092 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG dbcounter [-] [103771] Writing DB stats nova_api:SELECT=14 {{(pid=103771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:12:43.851277 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-799a9d85-c7e3-46a9-b279-1bac0e26745b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012995 Jun 22 10:12:43.851815 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Wed Jun 22 10:12:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:12:43.863762 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-a21323a8-5703-4190-b391-26ecfe265fa5 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:12:43.871944 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-a21323a8-5703-4190-b391-26ecfe265fa5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011833 Jun 22 10:12:43.872464 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Wed Jun 22 10:12:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:12:43.884181 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-990b1d48-f686-4d90-b9ee-01c144e57465 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:12:43.892525 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-990b1d48-f686-4d90-b9ee-01c144e57465 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012018 Jun 22 10:12:43.894501 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Wed Jun 22 10:12:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:12:43.905207 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-aaf50090-b854-40a5-9223-09ad95651c15 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:12:43.913736 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-aaf50090-b854-40a5-9223-09ad95651c15 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012585 Jun 22 10:12:43.914284 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Wed Jun 22 10:12:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:17.885245 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-990b1d48-f686-4d90-b9ee-01c144e57465 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:17.886282 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-990b1d48-f686-4d90-b9ee-01c144e57465 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jun 22 10:16:17.886699 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jun 22 10:16:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:18.147696 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-a6e8ab53-fbd8-4b6a-bccc-8bd79a6e690b admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:18.148895 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:16:18.148895 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: warnings.warn(msg) Jun 22 10:16:18.150091 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-a6e8ab53-fbd8-4b6a-bccc-8bd79a6e690b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:18.150526 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-a6e8ab53-fbd8-4b6a-bccc-8bd79a6e690b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:18.151298 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-a6e8ab53-fbd8-4b6a-bccc-8bd79a6e690b admin admin] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:18.151720 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-a6e8ab53-fbd8-4b6a-bccc-8bd79a6e690b admin admin] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:18.185092 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-a6e8ab53-fbd8-4b6a-bccc-8bd79a6e690b admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152177 Jun 22 10:16:18.185655 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jun 22 10:16:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:16:19.017946 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-990b1d48-f686-4d90-b9ee-01c144e57465 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:19.018969 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-990b1d48-f686-4d90-b9ee-01c144e57465 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 22 10:16:19.020103 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jun 22 10:16:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:19.211702 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-ace06adf-2a4c-42c9-a373-5cc0a69608e9 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:19.212924 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:16:19.212924 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: warnings.warn(msg) Jun 22 10:16:19.214134 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-ace06adf-2a4c-42c9-a373-5cc0a69608e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:19.214567 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-ace06adf-2a4c-42c9-a373-5cc0a69608e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:19.215334 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-ace06adf-2a4c-42c9-a373-5cc0a69608e9 admin admin] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:19.215757 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-ace06adf-2a4c-42c9-a373-5cc0a69608e9 admin admin] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:19.234785 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-ace06adf-2a4c-42c9-a373-5cc0a69608e9 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074996 Jun 22 10:16:19.235316 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jun 22 10:16:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:16:30.510121 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-990b1d48-f686-4d90-b9ee-01c144e57465 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:30.515941 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-990b1d48-f686-4d90-b9ee-01c144e57465 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 22 10:16:30.515941 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jun 22 10:16:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:30.657884 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writing DB stats nova_cell0:SELECT=4 {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:30.658623 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writing DB stats nova_cell1:SELECT=4 {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:30.659605 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG dbcounter [-] [103772] Writing DB stats nova_api:SELECT=14 {{(pid=103772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:30.711348 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-32727539-d69c-42e7-ac7a-529dea827666 admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:30.712647 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:16:30.712647 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: warnings.warn(msg) Jun 22 10:16:30.717235 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-32727539-d69c-42e7-ac7a-529dea827666 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:30.717235 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-32727539-d69c-42e7-ac7a-529dea827666 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:30.717235 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-32727539-d69c-42e7-ac7a-529dea827666 admin admin] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:30.717235 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-32727539-d69c-42e7-ac7a-529dea827666 admin admin] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:30.741735 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-32727539-d69c-42e7-ac7a-529dea827666 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088701 Jun 22 10:16:30.742309 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jun 22 10:16:30 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:31.562698 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: DEBUG nova.api.openstack.wsgi [None req-990b1d48-f686-4d90-b9ee-01c144e57465 admin admin] Calling method '>' {{(pid=103771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:31.563709 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: INFO nova.api.openstack.requestlog [None req-990b1d48-f686-4d90-b9ee-01c144e57465 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 22 10:16:31.564101 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: [pid: 103771|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Wed Jun 22 10:16:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:31.755888 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG nova.api.openstack.wsgi [None req-182c838d-69dc-4c12-9e15-88236ac711bf admin admin] Calling method '>' {{(pid=103772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:31.757084 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:16:31.757084 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: warnings.warn(msg) Jun 22 10:16:31.758734 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-182c838d-69dc-4c12-9e15-88236ac711bf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.759378 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-182c838d-69dc-4c12-9e15-88236ac711bf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.760349 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-182c838d-69dc-4c12-9e15-88236ac711bf admin admin] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.760778 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: DEBUG oslo_concurrency.lockutils [None req-182c838d-69dc-4c12-9e15-88236ac711bf admin admin] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.782785 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: INFO nova.api.openstack.requestlog [None req-182c838d-69dc-4c12-9e15-88236ac711bf admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079524 Jun 22 10:16:31.783270 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: [pid: 103772|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Wed Jun 22 10:16:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:17:29.114897 dv-cinder-843277-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 22 10:17:29.115635 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: Wed Jun 22 10:17:29 2022 - graceful shutdown triggered... Jun 22 10:17:29.116110 dv-cinder-843277-5-iscsi devstack@n-api.service[103771]: Gracefully killing worker 1 (pid: 103771)... Jun 22 10:17:29.116465 dv-cinder-843277-5-iscsi devstack@n-api.service[103772]: Gracefully killing worker 2 (pid: 103772)... Jun 22 10:17:30.116780 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: worker 1 buried after 1 seconds Jun 22 10:17:30.117356 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: worker 2 buried after 1 seconds Jun 22 10:17:30.117356 dv-cinder-843277-5-iscsi devstack@n-api.service[103770]: goodbye to uWSGI. Jun 22 10:17:30.119032 dv-cinder-843277-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 22 10:17:30.119596 dv-cinder-843277-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 22 10:17:30.122440 dv-cinder-843277-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 10:17:30.135148 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 10:17:30 2022] *** Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: nodename: dv-cinder-843277-5-iscsi Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: machine: x86_64 Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: clock source: unix Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: pcre jit disabled Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: detected number of CPU cores: 4 Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: current working directory: / Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: detected binary path: /usr/bin/uwsgi-core Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: your processes number limit is 47680 Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: your memory page size is 4096 bytes Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: detected max file descriptor number: 2048 Jun 22 10:17:30.138358 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: lock engine: pthread robust mutexes Jun 22 10:17:30.139569 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: thunder lock: enabled Jun 22 10:17:30.139569 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 10:17:30.139569 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 10:17:30.190175 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: Python main interpreter initialized at 0x55aa48a519c0 Jun 22 10:17:30.190175 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: python threads support enabled Jun 22 10:17:30.190175 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: your server socket listen backlog is limited to 100 connections Jun 22 10:17:30.190175 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: your mercy for graceful operations on workers is 90 seconds Jun 22 10:17:30.190915 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 10:17:30.191026 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: *** Operational MODE: preforking *** Jun 22 10:17:30.191747 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: *** uWSGI is running in multiple interpreter mode *** Jun 22 10:17:30.191747 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: spawned uWSGI master process (pid: 118307) Jun 22 10:17:30.191958 dv-cinder-843277-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 10:17:30.193467 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: spawned uWSGI worker 1 (pid: 118326, cores: 1) Jun 22 10:17:30.193639 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: spawned uWSGI worker 2 (pid: 118327, cores: 1) Jun 22 10:17:30.193765 dv-cinder-843277-5-iscsi devstack@n-api.service[118307]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 10:17:30.860721 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 10:17:30.876892 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 10:17:32.064354 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:17:32.064354 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: from cryptography.utils import int_from_bytes Jun 22 10:17:32.065124 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:17:32.065124 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: from cryptography.utils import int_from_bytes Jun 22 10:17:32.065578 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:17:32.065578 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: from cryptography.utils import int_from_bytes Jun 22 10:17:32.065996 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:17:32.065996 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: from cryptography.utils import int_from_bytes Jun 22 10:17:34.478020 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:17:34.478614 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:17:34.478897 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:17:34.479105 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:17:34.479362 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:17:34.479753 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.480089 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.480710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.480710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.481067 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.481279 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:17:34.481668 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.481747 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:17:34.481826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.482008 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.482405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:17:34.482511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.482601 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:17:34.482675 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.482755 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:17:34.482966 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.483066 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.483287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-5-iscsi {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.483453 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.483542 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.483709 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.483989 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.484098 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.484192 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.484366 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.484523 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.484674 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.484846 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.485034 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.485202 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.485358 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.485510 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.485690 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.485904 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.486169 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.486336 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.486600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-5-iscsi {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.486983 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.487288 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.487618 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.487934 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.488061 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.488247 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.488372 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.488577 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.488699 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.489051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.489161 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.489401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.489599 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.489915 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.490044 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.490222 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.490521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.490633 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.490850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.490961 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.491171 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.491279 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.491490 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.491609 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.491943 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.492100 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-5-iscsi {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.493371 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.493451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.493527 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.493606 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.493691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.493773 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.493851 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-5-iscsi {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.494481 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.494481 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.494686 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.494773 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.494857 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.495113 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.495223 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.495445 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.495768 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.495945 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.496094 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.496249 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.496431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.496589 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.496758 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.497006 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.497158 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.497416 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.497685 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.497843 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.498030 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.498192 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.498363 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.498511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.498682 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.498841 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.499006 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.499166 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.499315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.499455 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.499638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.499795 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.499945 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.500087 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.500235 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.500384 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.500534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.500693 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.500874 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.501034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.501195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.501347 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.501488 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.501648 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.501797 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.501941 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.502092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.502248 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.502403 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.502552 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.502712 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.502864 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.503015 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.503170 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.503315 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.503463 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.503603 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.503751 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.503900 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.504066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.504220 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.504369 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.504521 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.504661 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.504801 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.504982 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.505132 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.505281 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.505431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.505573 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.505726 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.505876 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.506028 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.506177 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.506320 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.506485 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.506638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.506804 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.506996 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.507147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.507295 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.507556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.507720 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.507874 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.508014 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.508166 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.508888 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.509088 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.509260 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.509412 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.509565 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.509714 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.509863 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.510053 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.510203 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.510353 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.510493 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.510668 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.510817 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.511001 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.511158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.511343 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.511498 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.511649 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.511796 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.511951 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.512101 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.512253 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.512402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.512543 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.512693 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.512894 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.513124 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.513294 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.513444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.513591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.513740 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.513891 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.514040 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.514183 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.514330 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.514483 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.514635 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.514778 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.514926 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.515170 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.515336 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.515541 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.515701 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.515853 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.516003 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.516179 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.516327 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.516475 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.516662 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.516837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.517001 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.517151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.517324 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.517492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.517711 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.517857 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.517998 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.518146 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.518289 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.518443 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.518592 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.518735 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.518898 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.519148 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.519304 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.519458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.519610 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.519780 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.519939 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.520118 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.520268 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.521002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.521106 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.521196 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.521278 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.521363 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.521437 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.521777 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.521898 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.521976 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.522053 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.522177 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.522359 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.522472 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.522793 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.522893 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.523065 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.523249 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.523401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.523565 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.523985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.524144 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.524309 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.524453 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.524606 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.524763 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.524936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.525080 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.525235 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.525390 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.525542 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.525683 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.525831 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.525980 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.526132 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.526281 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.526456 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.526614 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.526787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.526937 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.527089 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.527230 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.527408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.527565 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.527707 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.527848 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.528037 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.528205 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.528386 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.528536 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.528731 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.528906 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.529078 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.529244 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.529389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.529529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.529761 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.530104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.530432 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.530875 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.531053 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:17:34.531198 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.531347 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.531498 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.531647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.531799 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.532013 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.532161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.532330 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.532492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.532645 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.532795 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.533082 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.533227 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.533367 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.533509 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.533664 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.533814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.533965 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.534213 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.534363 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.534564 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.534729 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.534889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.535222 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.535555 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.535877 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.536230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.536585 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.536743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.536933 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.537130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.537279 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.537468 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.537618 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.537902 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.538061 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.538213 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.538508 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.538657 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.538837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.539151 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.539308 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.539511 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.539764 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.539921 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.540157 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.540305 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.540479 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.540638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.540834 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.541003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.541164 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.541314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.541457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.541605 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.541771 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.541922 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.542079 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.542228 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.542406 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.542563 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.542712 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.542918 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.543070 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.543249 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.543407 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.543593 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.543751 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.543932 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.544094 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.544244 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.544394 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.544558 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.544708 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.544992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.545162 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.545305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.545446 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.545587 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.545728 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.545882 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.546034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.546177 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.546317 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.546465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.546617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.546842 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.546996 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.547148 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.547391 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.547547 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.547702 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.548015 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.548163 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.548312 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.548612 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.548761 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.548969 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.549288 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.549443 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.549625 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.549945 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.550101 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.550256 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.550405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.550580 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.550751 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.550892 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.551040 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.551195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.551376 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.551527 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.551709 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.551872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.552028 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.552178 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.552356 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.552514 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.552678 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.552859 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.553027 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.553178 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.553321 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.553468 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.553636 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.553785 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.553974 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.554124 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.554318 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.554467 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.554638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.554795 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.554978 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.555649 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.555808 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.555992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.556161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.556313 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.556526 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.556682 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.556850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.557001 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.557153 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.557309 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.557459 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.557601 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.557743 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.557891 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.558032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.558189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.558336 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.558504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.558647 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.558797 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.558940 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.559095 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.559238 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.559378 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.559528 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.559670 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.559826 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.559976 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.560125 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.560267 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.560424 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.560574 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.560730 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.560966 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.561139 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.561284 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.561433 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.561583 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.561739 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.561890 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.562034 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.562182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.562331 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.562606 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.562764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.562937 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.563085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.563261 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.563411 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.563587 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.563745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.563894 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.564046 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.564214 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.564371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.564533 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.564682 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.564846 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.564996 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.565179 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.565339 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.565493 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.565635 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.566387 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.566544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.566687 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.566844 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.567008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.567161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.567311 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.567453 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.567610 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.567753 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.567895 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.568036 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.568036 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.568315 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.568477 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.568809 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.568999 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.569291 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.569445 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.569741 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.569885 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.570026 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.570183 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.570327 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.570478 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.570627 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.570815 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.571469 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.571624 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.571772 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.571772 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.572039 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.572180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.572329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.572480 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.572629 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.572771 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.572983 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.573126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.573278 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.573430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.573579 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.573730 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.573872 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.574021 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.574175 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.574324 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.574473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.574615 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.574763 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.574922 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.575077 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.575220 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.575360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.575501 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.575642 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.575790 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.575940 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.576081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.576222 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.576364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.576505 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.576647 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.576805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.576974 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.577115 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.577274 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.577417 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.577557 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.577778 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.577929 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.578078 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.578228 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.578378 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.578542 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.578700 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.578851 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.578993 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.579142 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.579307 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.579465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.579614 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.579764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.579914 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.580056 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.580204 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.580359 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.580359 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.580646 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.580789 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.580980 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.581131 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.581282 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.581430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.581572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.581712 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.581861 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.582019 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.582160 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.582317 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.582460 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.582611 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.582759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.582910 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.583087 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.583294 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.583453 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.583603 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.583746 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.583914 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.584062 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.584211 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.584353 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.584495 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.584647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.584798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.585559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.585706 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.585855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.585998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.586154 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.586304 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.586590 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.586746 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.586897 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.587047 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.587218 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.587369 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.587520 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.587669 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.587811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.587971 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.588121 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.588271 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.588413 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.588561 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.588708 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.588934 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.589096 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.589241 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.589391 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.589533 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.589674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.589825 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.589975 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.590132 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.590283 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.590433 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.590589 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.590744 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.590887 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.591044 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.591044 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.591329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.591484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.591627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.591775 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.591924 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.591924 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.592200 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.592358 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.592500 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.592648 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.592791 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.597768 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.597882 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.597986 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.598073 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.598158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.598240 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.598331 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.598416 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.598554 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.598645 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.598728 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.598818 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.598908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.599005 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.599094 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.599178 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.599260 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.599350 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.599456 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.599549 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.599642 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.599726 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.599809 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.599896 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.599990 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.600083 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.600176 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.600268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.600362 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.600448 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.600448 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.600663 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.600751 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.600852 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.600953 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.601041 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.601132 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.601225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.601317 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.601402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.601499 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.601592 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.601685 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.601778 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.601862 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.601946 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.602061 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.602156 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.602240 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.602319 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.602397 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.602519 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.602608 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.602608 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.602734 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.602803 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.602871 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.602952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.603031 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.603102 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.603178 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.603254 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.603331 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.603476 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.603616 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.603746 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.603878 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.604014 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.604152 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.604281 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.604281 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.604532 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.604699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.604877 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.605011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.605140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.605241 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.605335 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.605429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.605429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.605695 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.606014 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.606334 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.606469 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.606679 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.606994 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.607313 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.607629 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.607956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.608245 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.608348 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.608580 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.608715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.608916 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.609026 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.609238 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.609334 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.609558 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.610120 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.610259 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.610573 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.610804 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.610908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.611189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.611335 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.611523 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.611658 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.612055 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.612209 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.612342 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.612479 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.612610 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.612773 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.612927 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.613127 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.613262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.613468 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.613615 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.613797 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.613924 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.614136 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.614268 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.614455 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.614596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.614772 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.614914 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.615092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.615227 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.615410 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.615544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.615743 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.615886 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.616074 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.616207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.616392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.616615 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.616757 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.616971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.617111 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.617242 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.617371 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.617509 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.618166 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.618340 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.618497 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.618752 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.618907 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.619048 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.619179 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.619305 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.619434 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.619627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.619774 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.619953 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.620086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.620277 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.620401 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.620597 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.620727 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.620959 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.621094 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.621276 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.621458 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.621600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.621784 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.621918 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.622108 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.622242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.622426 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.622593 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.622741 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.622909 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.623052 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.623237 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.623371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.623567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.623710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.623889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.624031 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.624274 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.624416 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.624555 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.624728 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.624921 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.628100 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.628206 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.628294 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.628392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.628485 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.628577 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.628662 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.628751 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.628920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.629022 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.629115 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.629207 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.629292 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.629384 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.629476 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.629570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.629655 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.629746 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.629832 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.629922 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.630017 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.630109 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.630194 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.630285 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.630370 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.630462 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.630561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.630647 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.630736 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.630821 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.630911 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.630996 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.631093 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.631186 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.631272 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.631362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.631454 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.631546 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.631643 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.631729 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.631813 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.631903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.631996 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.632099 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.632194 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.632286 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.632372 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.632462 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.632547 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.632644 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.632860 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.632971 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.633179 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.633319 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.634125 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.634277 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.634496 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.634628 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.634759 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.634847 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.635043 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.635146 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.635361 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.635474 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.635677 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.635768 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.636007 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.636130 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.636328 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.636454 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.636648 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.636782 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.636991 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.637133 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.637351 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.637486 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.637670 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.637804 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.638087 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.638230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.638409 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.638551 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.638738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.638871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.639071 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.639213 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.639395 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.639530 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.639721 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.639863 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.640049 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.640190 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.640367 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.640501 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.640697 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.640860 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.641043 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.641191 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.641368 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.641507 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.641681 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.641828 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.641993 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.642125 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.642306 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.642443 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.642641 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.642784 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.642958 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.643100 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.643290 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.643429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.643630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.643772 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.643966 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.644100 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.644286 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.644432 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.644649 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.644769 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.644993 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.645127 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.645318 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.645554 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.645701 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.645838 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.645973 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.646098 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.646269 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.646400 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.646595 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.646726 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.646921 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.647053 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.647244 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.647464 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.647602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.647736 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.647910 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.648028 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.648228 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.648356 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.648545 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.648662 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.649170 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.651598 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.651745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.651889 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.651889 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.652067 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.652160 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.652253 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.652346 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.652441 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.652535 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.652620 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.652699 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.652791 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.652951 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.653040 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.653040 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.653201 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.653287 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.653381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.653479 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.653565 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.653649 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.653732 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.653824 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.653916 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.654014 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.654106 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.654191 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.654325 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.654413 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.654505 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.654621 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.654766 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.654874 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.654969 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.655063 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.655195 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.655326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.655461 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.655606 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.655743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.655889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.656063 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.656197 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.656452 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.656669 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.656775 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.657023 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.657123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.657365 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.657468 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.657684 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.657792 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.658015 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.658109 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.658402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.658505 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.658723 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.658827 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.659040 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.659134 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.659357 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.659458 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.659673 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.659780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.660030 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.660132 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.660345 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.660437 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.660674 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.660876 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.661029 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.661173 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.661373 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.661497 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.661699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.661919 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.662039 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.662262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.662553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.662670 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.662819 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.663117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.663237 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.663459 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.663585 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.663779 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.663928 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.664589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.664731 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.664876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.664996 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.665120 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.665266 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.665741 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.665865 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.665987 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.666110 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.666200 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.666273 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.666343 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.666413 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.666490 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.666568 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.666652 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.666724 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.666989 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.667137 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.667281 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.667477 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.667571 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.667803 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.667897 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.668140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.668292 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.668455 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.668562 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.668774 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.668911 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.669173 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.674077 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.674077 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.674274 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.674363 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.674528 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.674619 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.674785 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.674882 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.674969 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.674969 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.675132 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.675225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.675325 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.675438 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.675712 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.675915 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.676019 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.676106 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.676205 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.676339 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.676426 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.676565 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.676661 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.676756 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.676867 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.676968 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.677068 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.677162 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.677248 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.677347 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.677434 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.677434 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.677596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.677679 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.677762 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.677855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.677940 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.677940 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.678099 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.678185 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.678264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.678360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.678447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.678531 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.678622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.678706 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.678798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.678883 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.678967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.679051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.679142 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.679364 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.679509 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.679509 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.679732 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.679850 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.679968 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.680078 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.680770 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.680920 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.681033 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.681156 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.681275 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.681399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.681511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.681619 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.681728 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.681836 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.681944 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.682061 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.682171 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.682287 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.682398 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.682507 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.682616 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.682734 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.682855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.682965 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.683074 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.683184 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.683307 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.683440 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.683577 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.683707 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.683844 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.683982 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.684125 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.684262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.684399 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.684536 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.684667 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.684806 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.685021 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.685160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.685290 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.685426 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.685564 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.685718 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.686073 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.686218 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.686356 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.686495 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.686625 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.686775 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.686906 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.687099 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.687204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.687501 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.687637 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.687836 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.688002 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.688163 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.688353 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.688699 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.688799 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.689047 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.689149 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.689394 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.689523 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.689734 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.689854 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.690064 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.690174 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.690392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.690500 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.690718 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.690828 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.691046 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.691150 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.691363 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.691467 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.691682 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.691789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.692002 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.692175 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.692338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.692481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.692655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.692852 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.693007 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.693150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.693320 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.693608 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.693776 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.693952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.694102 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.694253 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.694416 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.694568 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.694852 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.695014 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.695159 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.695317 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.695461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.695611 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.695822 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.696752 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.696949 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.697097 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.697249 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.697415 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.697560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.697721 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.697958 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.698110 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.698263 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.698430 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.698575 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.698718 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.698861 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.699003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.699146 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.699317 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.699462 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.699612 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.699756 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.699906 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.700050 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.700202 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.700354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.700506 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.700654 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.700654 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.700973 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.701136 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.701288 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.701433 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.701582 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.701732 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.701970 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.702125 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.702269 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.702420 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.702565 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.702721 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.702864 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.703006 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.703167 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.703311 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.703462 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.703619 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.703762 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.703904 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.704046 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.704188 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.704337 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.704493 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.704638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.704788 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.705052 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.705203 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.705346 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.705503 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.705657 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.705800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.705942 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.706085 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.706236 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.706386 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.706555 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.706879 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.707034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.707188 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.707342 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.707490 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.707634 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.707777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.707919 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.708174 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.708343 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.708490 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.708633 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.708784 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.708965 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.709117 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.709279 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.709424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.709567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.709710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.709861 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.710018 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.710162 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.710338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.710496 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.710673 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.710826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.711023 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.711193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.711366 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.711515 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.711658 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.711807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.711964 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.712116 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.712267 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.712409 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.712629 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.712805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.712998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.713189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.713357 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.713504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.713646 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.713842 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.713995 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.714182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.714340 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.714513 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.714671 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.714825 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.714966 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.715197 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.715355 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.715509 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.715660 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.715816 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.715959 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.716109 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.716252 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.716401 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.716557 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.716719 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.716934 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.717084 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.717228 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.717392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.717551 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.717694 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.717835 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.717988 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.718269 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.718437 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.718605 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.718757 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.718908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.719052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.719196 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.719337 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.719503 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.719654 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.719824 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.719983 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.720135 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.720287 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.720437 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.720580 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.720788 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.720972 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.721118 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.721274 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.721435 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.721651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.721802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.721979 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.722129 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.722310 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.722469 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.722642 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.722800 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.722951 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.723101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.723268 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.723442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.723595 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.723745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.723898 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.724049 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.724230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.724386 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.724553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.724703 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.724890 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.725057 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.725219 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.725443 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.725594 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.725760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.725904 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.726060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.726204 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.726354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.726497 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.726641 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.726797 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.726940 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.727627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.727786 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.727958 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.728175 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.728361 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.728600 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.728759 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.729077 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.729225 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.729379 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.729533 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.729776 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.729934 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.730321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.730651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.730978 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.731190 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.731341 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.731612 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.731931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.732253 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.732573 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.732916 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.733071 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.733225 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.733369 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.733544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.733776 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.733932 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.734356 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.734503 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.734762 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.735076 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.735234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.735485 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.735655 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.735800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.735952 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.736106 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.736256 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.736400 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.736553 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.736696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.736914 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.737087 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.737239 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.737383 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.737568 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.737719 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.737900 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.738062 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.738230 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.738388 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.738561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.738827 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.738976 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.739129 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.739273 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.739415 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.739565 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.739709 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.739866 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.740010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.740161 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.740313 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.740464 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.740617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.740774 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.741031 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.741190 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.741351 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.741502 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.741646 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.741799 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.741941 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.742083 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.742234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.742384 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.742547 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.742797 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.743457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.743630 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.743787 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.743957 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.744118 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.744297 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.744448 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.744619 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.744775 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.744948 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.745282 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.745444 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.745679 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.745838 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.745990 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.746147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.746291 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.746443 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.746586 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.746736 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.746888 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.747040 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.747209 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.747316 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.747501 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.747655 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.747842 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.748002 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.748183 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.748342 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.748545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.748697 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.748964 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.749117 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.749260 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.749402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.749567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.749719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.749872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.750024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.750175 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.750318 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.750461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.750602 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.750759 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:17:34.750904 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.751148 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.751458 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.751778 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.752096 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.752419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.752739 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.753082 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.753400 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.753716 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.754037 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.754351 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.754667 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.754984 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.755301 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.755618 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.755935 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.756254 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.756569 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.756909 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.757230 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.757547 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.757860 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.758207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.758577 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.758903 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.759241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.759565 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.759899 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.760221 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.760561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.760916 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.761246 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.761567 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.761915 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.762238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.762593 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.762920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.763243 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.763565 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.763891 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.764260 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.764627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.764970 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.765316 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.765646 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.765981 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.766308 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.766632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.766974 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.767297 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.767617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.767944 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.768269 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.768598 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.768977 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.769305 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.769645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.769984 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.770304 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.770650 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.770991 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.771351 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.771674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.772029 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.772369 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.772697 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.773047 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.773364 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:17:34.773614 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118326) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:17:34.813685 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO dbcounter [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] Registered counter for database nova_api Jun 22 10:17:34.834112 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_db.sqlalchemy.engines [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:17:34.837037 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO dbcounter [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] Registered counter for database nova_api Jun 22 10:17:34.841310 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writer thread running {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:17:34.858134 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_db.sqlalchemy.engines [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:17:34.865165 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writer thread running {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:17:34.901249 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.context [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6(cell1) {{(pid=118327) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 10:17:34.905487 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:34.907435 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:34.907954 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:34.909992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:34.912035 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO dbcounter [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] Registered counter for database nova_cell0 Jun 22 10:17:34.916741 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO dbcounter [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] Registered counter for database nova_cell1 Jun 22 10:17:34.923624 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.context [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6(cell1) {{(pid=118326) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 10:17:34.924760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_db.sqlalchemy.engines [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:17:34.926088 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_db.sqlalchemy.engines [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:17:34.927859 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:34.929540 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:34.931011 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:34.933044 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:34.933316 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writer thread running {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:17:34.935048 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO dbcounter [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] Registered counter for database nova_cell0 Jun 22 10:17:34.935415 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writer thread running {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:17:34.939163 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO dbcounter [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] Registered counter for database nova_cell1 Jun 22 10:17:34.946427 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_db.sqlalchemy.engines [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:17:34.948628 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_db.sqlalchemy.engines [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:17:34.955571 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writer thread running {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:17:34.956829 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writer thread running {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:17:35.088661 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO dbcounter [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] Registered counter for database nova_cell0 Jun 22 10:17:35.096357 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_db.sqlalchemy.engines [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:17:35.103425 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writer thread running {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:17:35.107738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO dbcounter [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] Registered counter for database nova_cell0 Jun 22 10:17:35.114867 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_db.sqlalchemy.engines [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118326) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:17:35.121091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writer thread running {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:17:35.431763 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: WARNING keystonemiddleware.auth_token [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:17:35.439338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: WARNING keystonemiddleware.auth_token [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:17:35.448283 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: WARNING keystonemiddleware.auth_token [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:17:35.455534 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: WARNING keystonemiddleware.auth_token [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:17:35.785189 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: WARNING keystonemiddleware.auth_token [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:17:35.791327 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: WARNING keystonemiddleware.auth_token [None req-399044a2-db35-4a72-a742-47e7c2f51393 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:17:35.797181 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aa48a519c0 pid: 118327 (default app) Jun 22 10:17:35.802383 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: WARNING keystonemiddleware.auth_token [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:17:35.808520 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: WARNING keystonemiddleware.auth_token [None req-65d698ba-8546-4bcf-aca2-6bc44b5aba34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:17:35.814166 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aa48a519c0 pid: 118326 (default app) Jun 22 10:18:16.440150 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:16.441680 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:16.443021 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:16.443812 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:17.714562 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6efbf702-5da2-4d49-83f5-08c52a685f9c tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Action: 'create', calling method: .version_select at 0x7f022dc7d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1416331451"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:17.860186 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=3 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:17.869988 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=3 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:17.869988 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=3 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:17.869988 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=3 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:19.277850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ae9354a5-a7d3-4b35-96c5-cb1f157ebcdc tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Action: 'create', calling method: .version_select at 0x7f022dc79790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-425923822", "metadata": {"Type": "work"}}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:20.518043 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6efbf702-5da2-4d49-83f5-08c52a685f9c tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.081082 Jun 22 10:18:20.525473 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1154 bytes} [Wed Jun 22 10:18:16 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4092 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 10:18:20.531618 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9c482b1b-7b46-4402-a751-a301a52ab7fd tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022db42550>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:20.887392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9c482b1b-7b46-4402-a751-a301a52ab7fd tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6" status: 200 len: 345 microversion: 2.1 time: 0.360141 Jun 22 10:18:20.888065 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 2/2] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:20 2022] GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6 => generated 345 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:18:21.173661 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ae9354a5-a7d3-4b35-96c5-cb1f157ebcdc tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.323395 Jun 22 10:18:21.175154 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1155 bytes} [Wed Jun 22 10:18:17 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3327 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 10:18:21.191055 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-217e4002-d3b5-4ab2-b348-0540ceb1b238 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Calling method '.version_select at 0x7f022db428b0>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:21.304315 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-217e4002-d3b5-4ab2-b348-0540ceb1b238 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0" status: 200 len: 352 microversion: 2.1 time: 0.120515 Jun 22 10:18:21.307305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 3/4] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:21 2022] GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:21.904960 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f725608b-2b35-45eb-88a4-c5b7d87027e1 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022db435e0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:22.006378 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f725608b-2b35-45eb-88a4-c5b7d87027e1 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6" status: 200 len: 346 microversion: 2.1 time: 0.108225 Jun 22 10:18:22.013061 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 2/5] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:21 2022] GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6 => generated 346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:22.022211 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a8d8137d-1d64-441a-9fcf-6610497abf4b tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Action: 'create', calling method: .version_select at 0x7f022db42ca0>, body: {"snapshot": {"volume_id": "097ade2e-ec11-45d3-bf86-8480665e7fb6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-276646061"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:22.317960 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7dd34da0-1900-4c1e-94ab-1c5cdd2d40b6 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Calling method '.version_select at 0x7f022db43700>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:22.426087 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7dd34da0-1900-4c1e-94ab-1c5cdd2d40b6 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0" status: 200 len: 353 microversion: 2.1 time: 0.110363 Jun 22 10:18:22.427038 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 3/6] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:22 2022] GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:18:22.437967 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-adc3d9e9-9a95-4f1c-9a97-d8220f2d6e14 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Calling method '.version_select at 0x7f022db43dc0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:22.825892 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-adc3d9e9-9a95-4f1c-9a97-d8220f2d6e14 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0" status: 200 len: 353 microversion: 2.1 time: 0.391750 Jun 22 10:18:22.826275 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:22 2022] GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 => generated 353 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:18:22.844241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-60b1ce91-0872-45f8-b265-98cde460e8b3 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Calling method '.version_select at 0x7f022dadb4c0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:22.860216 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a8d8137d-1d64-441a-9fcf-6610497abf4b tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.845424 Jun 22 10:18:22.861442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 4/8] 10.222.0.46 () {60 vars in 1161 bytes} [Wed Jun 22 10:18:22 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:18:22.877092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e0e69968-aea8-4952-b803-3a5483d842ff tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022db58940>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:22.928597 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e0e69968-aea8-4952-b803-3a5483d842ff tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445" status: 200 len: 286 microversion: 2.1 time: 0.055338 Jun 22 10:18:22.929506 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 5/9] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jun 22 10:18:22 2022] GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:18:22.938913 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-073ce048-24e0-46a6-b65d-ad7773cfe335 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022db42e50>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:23.045694 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-073ce048-24e0-46a6-b65d-ad7773cfe335 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.110332 Jun 22 10:18:23.049200 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 6/10] 10.222.0.46 () {58 vars in 1139 bytes} [Wed Jun 22 10:18:22 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:18:23.057650 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cb0ee322-ba6f-40e0-baf3-80d6cdc0e71a tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022db58af0>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:23.154300 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-60b1ce91-0872-45f8-b265-98cde460e8b3 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0" status: 202 len: 0 microversion: 2.1 time: 0.314506 Jun 22 10:18:23.154942 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 5/11] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jun 22 10:18:22 2022] DELETE /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:18:23.163874 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-307ea0ab-99df-4357-b1ad-3f454265b5b8 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Calling method '.version_select at 0x7f022db43d30>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:23.274180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cb0ee322-ba6f-40e0-baf3-80d6cdc0e71a tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445" status: 200 len: 286 microversion: 2.1 time: 0.221008 Jun 22 10:18:23.275950 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 7/12] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jun 22 10:18:23 2022] GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 => generated 286 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:18:23.406820 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-307ea0ab-99df-4357-b1ad-3f454265b5b8 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0" status: 200 len: 352 microversion: 2.1 time: 0.246662 Jun 22 10:18:23.408308 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 6/13] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:23 2022] GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 => generated 352 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:24.288213 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f723f70b-ebd6-42b3-866f-3bf80e0c6d5a tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022db58280>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:24.384002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f723f70b-ebd6-42b3-866f-3bf80e0c6d5a tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445" status: 200 len: 286 microversion: 2.1 time: 0.092983 Jun 22 10:18:24.384002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 8/14] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jun 22 10:18:24 2022] GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:24.419613 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3a2e4566-0ea5-496e-b0c7-f599600d71c2 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Calling method '.version_select at 0x7f022db438b0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:24.502634 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3a2e4566-0ea5-496e-b0c7-f599600d71c2 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0" status: 200 len: 352 microversion: 2.1 time: 0.086805 Jun 22 10:18:24.503522 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 7/15] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:24 2022] GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:25.389825 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-dc95901d-33c8-449d-8a64-685ef964694f tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022db42af0>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:25.422864 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-dc95901d-33c8-449d-8a64-685ef964694f tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445" status: 200 len: 286 microversion: 2.1 time: 0.037272 Jun 22 10:18:25.423549 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 9/16] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jun 22 10:18:25 2022] GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:25.516353 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-43f1da1f-8ff1-4402-9b63-a21cc69aa16e tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Calling method '.version_select at 0x7f022dadb670>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:25.628479 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-43f1da1f-8ff1-4402-9b63-a21cc69aa16e tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0" status: 200 len: 352 microversion: 2.1 time: 0.116733 Jun 22 10:18:25.629571 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 8/17] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:25 2022] GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:26.436730 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-788fc143-17ac-4132-ae60-06e95228af2d tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022db42f70>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:26.500436 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-788fc143-17ac-4132-ae60-06e95228af2d tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445" status: 200 len: 286 microversion: 2.1 time: 0.069165 Jun 22 10:18:26.501151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 10/18] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jun 22 10:18:26 2022] GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:26.642170 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-61262948-06c3-4e4d-87fb-7c4aa70d9b39 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Calling method '.version_select at 0x7f022db43700>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:26.792428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-61262948-06c3-4e4d-87fb-7c4aa70d9b39 tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0" status: 200 len: 352 microversion: 2.1 time: 0.154619 Jun 22 10:18:26.793750 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 9/19] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:26 2022] GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 => generated 352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:27.512378 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-927aa6b9-2e6f-44a9-9cd1-c2595e2f50fc tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022db581f0>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:27.578276 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-927aa6b9-2e6f-44a9-9cd1-c2595e2f50fc tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445" status: 200 len: 286 microversion: 2.1 time: 0.070417 Jun 22 10:18:27.583255 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 11/20] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jun 22 10:18:27 2022] GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:27.806053 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-12ee8d95-1c59-476f-b85d-e583493d74ef tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Calling method '.version_select at 0x7f022db43dc0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:27.917531 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-12ee8d95-1c59-476f-b85d-e583493d74ef tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0" status: 200 len: 352 microversion: 2.1 time: 0.116879 Jun 22 10:18:27.918529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 10/21] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:27 2022] GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:28.591293 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e94b75bc-c37d-4ad7-aae9-f41b1542d36a tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022dadb430>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:28.675051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e94b75bc-c37d-4ad7-aae9-f41b1542d36a tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445" status: 200 len: 286 microversion: 2.1 time: 0.088854 Jun 22 10:18:28.677282 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 11/22] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jun 22 10:18:28 2022] GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:28.931466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4d4a5ed8-da09-441e-8d5c-c1a188774bff tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Calling method '.version_select at 0x7f022dadb4c0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:28.997054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1061890774", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:29.032353 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4d4a5ed8-da09-441e-8d5c-c1a188774bff tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0" status: 200 len: 352 microversion: 2.1 time: 0.104602 Jun 22 10:18:29.032623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 12/23] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:28 2022] GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:29.202373 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.network.neutron [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] validate_networks() for [('d87deb7b-7760-4ec4-9151-26b90b71d248', None, None, None, None, None)] {{(pid=118327) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:18:29.695870 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-037a1031-87e6-4f12-b52b-69f66a315bd7 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022db43ee0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:29.747935 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-037a1031-87e6-4f12-b52b-69f66a315bd7 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445" status: 200 len: 287 microversion: 2.1 time: 0.063353 Jun 22 10:18:29.749197 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 13/24] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jun 22 10:18:29 2022] GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:29.769823 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-64cfeb1e-d9f1-4f52-8939-6db0b0337cc1 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022db43550>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:30.000958 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-64cfeb1e-d9f1-4f52-8939-6db0b0337cc1 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445" status: 202 len: 0 microversion: 2.1 time: 0.243234 Jun 22 10:18:30.002377 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 14/25] 10.222.0.46 () {58 vars in 1253 bytes} [Wed Jun 22 10:18:29 2022] DELETE /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:18:30.012421 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3ee01eec-cad4-4ba9-b551-0f010fc4aa27 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022dadbb80>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:30.076951 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3ee01eec-cad4-4ba9-b551-0f010fc4aa27 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445" status: 200 len: 286 microversion: 2.1 time: 0.068233 Jun 22 10:18:30.077964 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 15/26] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jun 22 10:18:30 2022] GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:30.082630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-935a4f97-ae90-4484-9fa0-3c79271bcd5b tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Calling method '.version_select at 0x7f022dadb430>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:30.213310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-935a4f97-ae90-4484-9fa0-3c79271bcd5b tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] HTTP exception thrown: Volume 6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 could not be found. Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-935a4f97-ae90-4484-9fa0-3c79271bcd5b tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Request method failure captured: Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 HTTP/1.1 Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisuxpTCd0iB7EZsHc8h2O98iEMb7EMa41qd-pIbN95lnMUFEB1JEpPGN7CofsP80GHU4ovwcYTyvVN2fyRAVQWLrb3PkFX_-xAFV3XsyHPBWiUpfrN1P0Rnk00IhKatGSWPbThUE-Df08GUaGnUpb8OdSLQMe97ccXpBvTw0ym0higLI Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: d30dff4ba8fe401989c5f8d53a79af4c Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-VolumesGetTestJSON-154704872 Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:18:30.217405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d30dff4ba8fe401989c5f8d53a79af4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d30dff4ba8fe401989c5f8d53a79af4c", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d30dff4ba8fe401989c5f8d53a79af4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d30dff4ba8fe401989c5f8d53a79af4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-VolumesGetTestJSON-154704872 Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: d30dff4ba8fe401989c5f8d53a79af4c Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-VolumesGetTestJSON-154704872 Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-VolumesGetTestJSON-154704872-project Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 3eddc5541a26499995b06615dcfb821c Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-VolumesGetTestJSON-154704872-project Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Volume 6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 could not be found. Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '6f8f9739-3ed5-4199-be00-7ad6ee0da9e0'} Jun 22 10:18:30.218920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 could not be found. (HTTP 404) (Request-ID: req-05ea7af5-cc56-41ff-8f74-37b3f8a8a13a) Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:30.219742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:18:30.221075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 could not be found. Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 10:18:30.222715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 could not be found. Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 could not be found. Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-935a4f97-ae90-4484-9fa0-3c79271bcd5b tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] Returning 404 to user: Volume 6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-935a4f97-ae90-4484-9fa0-3c79271bcd5b tempest-VolumesGetTestJSON-154704872 tempest-VolumesGetTestJSON-154704872-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0" status: 404 len: 109 microversion: 2.1 time: 0.139990 Jun 22 10:18:30.224085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 16/27] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:30 2022] GET /compute/v2.1/os-volumes/6f8f9739-3ed5-4199-be00-7ad6ee0da9e0 => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:18:31.091071 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-aefcf18a-c9c7-407b-92aa-76e54c239270 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022dadbdc0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:31.148762 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-aefcf18a-c9c7-407b-92aa-76e54c239270 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] HTTP exception thrown: Snapshot dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 could not be found. Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-aefcf18a-c9c7-407b-92aa-76e54c239270 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Request method failure captured: Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 HTTP/1.1 Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisuxoAooBQRSw2dHBieayV_dNxth0R7xagtgTx6s-5syXGTahX0GOvYFKJilKao6wdTAkvVUQLEQObddSpZFAVsUSWASJkNh4NZiSe6AvrcVibs7VSgqkQ4pLxTWpqjMZMWfE-CJMwzRB8PR7vGUxyOT3-09nztxyLdl38nh4TV4DLKs Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 0521797f600144f4a5b5f844115029bb Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-345505235 Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:18:31.151492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0521797f600144f4a5b5f844115029bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0521797f600144f4a5b5f844115029bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0521797f600144f4a5b5f844115029bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0521797f600144f4a5b5f844115029bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-VolumesSnapshotsTestJSON-345505235 Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 0521797f600144f4a5b5f844115029bb Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-345505235 Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-VolumesSnapshotsTestJSON-345505235-project Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 52eb4e92ccdf466a9c26a54a10313bbe Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-VolumesSnapshotsTestJSON-345505235-project Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Snapshot dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 could not be found. Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': 'dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445'} Jun 22 10:18:31.152504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 could not be found. (HTTP 404) (Request-ID: req-b5c58d28-90de-40f0-8e91-9bf60f35c4c2) Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:31.153561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:18:31.154733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 could not be found. Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 22 10:18:31.155603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 could not be found. Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 could not be found. Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-aefcf18a-c9c7-407b-92aa-76e54c239270 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Returning 404 to user: Snapshot dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:18:31.157450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-aefcf18a-c9c7-407b-92aa-76e54c239270 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445" status: 404 len: 111 microversion: 2.1 time: 0.068068 Jun 22 10:18:31.159024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 17/28] 10.222.0.46 () {58 vars in 1250 bytes} [Wed Jun 22 10:18:31 2022] GET /compute/v2.1/os-snapshots/dcb9aceb-c1d9-479d-a4c0-d1df7d9aa445 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:18:31.176431 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-02d78b57-02bb-4bef-a7a6-6e94a029ed58 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022dac70d0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:31.451819 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-02d78b57-02bb-4bef-a7a6-6e94a029ed58 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6" status: 202 len: 0 microversion: 2.1 time: 0.292949 Jun 22 10:18:31.456837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 18/29] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jun 22 10:18:31 2022] DELETE /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:18:31.464559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5d9edad3-ca82-4757-9758-6fa7274044aa tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022dac7790>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:31.611348 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Flavor limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:18:31.611826 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Image limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:18:31.612248 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Flavor pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:18:31.612752 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Image pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:18:31.615748 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5d9edad3-ca82-4757-9758-6fa7274044aa tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6" status: 200 len: 345 microversion: 2.1 time: 0.157209 Jun 22 10:18:31.616507 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 19/30] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:31 2022] GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6 => generated 345 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:31.616714 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:18:31.641456 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:31.641962 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:31.642763 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:31.643205 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:31.776119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Getting quotas for project 30df978aece349c4baf14cc311f7b498. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:18:31.814169 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Getting quotas for user 425bf40bd45642a1aafeb65bdb9650af and project 30df978aece349c4baf14cc311f7b498. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:18:31.854128 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Going to run 1 instances... {{(pid=118327) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:18:31.868312 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:18:32.150851 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-116690f9-be41-45b3-ac54-0c4cc2a73e83 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.823914 Jun 22 10:18:32.153916 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 12/31] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:18:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 3828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 10:18:32.167054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3cfd2dde-0088-4c69-9854-9c1477e549a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:32.179025 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3cfd2dde-0088-4c69-9854-9c1477e549a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:32.188651 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2082485634", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "networks": [{"uuid": "a740e1fb-73ed-45c1-bc6a-78630e8b39de"}]}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:32.505005 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.network.neutron [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] validate_networks() for [('a740e1fb-73ed-45c1-bc6a-78630e8b39de', None, None, None, None, None)] {{(pid=118326) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:18:32.543188 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3cfd2dde-0088-4c69-9854-9c1477e549a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:32.572674 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3cfd2dde-0088-4c69-9854-9c1477e549a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1222 microversion: 2.1 time: 0.403558 Jun 22 10:18:32.576597 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 13/32] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:32 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1222 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:32.629854 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-09e3631c-e0f1-4e6e-bd1f-15c57fa1280a tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022db58ca0>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:32.772589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-09e3631c-e0f1-4e6e-bd1f-15c57fa1280a tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6" status: 200 len: 345 microversion: 2.1 time: 0.147475 Jun 22 10:18:32.774382 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 14/33] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:32 2022] GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6 => generated 345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:18:32.884254 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1549053205", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:33.024893 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.network.neutron [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] validate_networks() for [('d87deb7b-7760-4ec4-9151-26b90b71d248', None, None, None, None, None)] {{(pid=118327) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:18:34.728472 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Flavor limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:18:34.729020 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Image limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:18:34.729401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Flavor pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:18:34.729818 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Image pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:18:34.730233 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:18:34.758595 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.759732 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.760562 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.761022 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.839239 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Getting quotas for project d5e8f35bd8844091accf4166f837f057. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:18:34.860349 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Getting quotas for user 6e05fbada6264cfb826ae4c93254de5a and project d5e8f35bd8844091accf4166f837f057. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:18:34.897097 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Going to run 1 instances... {{(pid=118326) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:18:34.899887 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118326) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:18:35.022174 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Flavor limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:18:35.023353 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Image limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:18:35.024070 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Flavor pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:18:35.024705 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Image pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:18:35.025363 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:18:35.067379 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:35.068228 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:35.069408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:35.077610 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:35.114171 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Getting quotas for project 30df978aece349c4baf14cc311f7b498. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:18:35.119140 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Getting quotas for user 425bf40bd45642a1aafeb65bdb9650af and project 30df978aece349c4baf14cc311f7b498. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:18:35.133964 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Going to run 1 instances... {{(pid=118327) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:18:35.143118 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:18:35.224947 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6b1e4443-af7d-4d7e-bd25-7266ecbada14 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.556033 Jun 22 10:18:35.224947 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 20/34] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:18:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 3557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:18:35.271874 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-794fb962-a793-403a-9076-6081db98dec6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.391704 Jun 22 10:18:35.277580 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 15/35] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:18:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 10:18:35.286153 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-40cb633f-1b50-4ca6-91de-86a0732a4d6f tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022d20d430>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-40cb633f-1b50-4ca6-91de-86a0732a4d6f tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] HTTP exception thrown: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-40cb633f-1b50-4ca6-91de-86a0732a4d6f tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Request method failure captured: Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6 HTTP/1.1 Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisuxoAooBQRSw2dHBieayV_dNxth0R7xagtgTx6s-5syXGTahX0GOvYFKJilKao6wdTAkvVUQLEQObddSpZFAVsUSWASJkNh4NZiSe6AvrcVibs7VSgqkQ4pLxTWpqjMZMWfE-CJMwzRB8PR7vGUxyOT3-09nztxyLdl38nh4TV4DLKs Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 0521797f600144f4a5b5f844115029bb Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-345505235 Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:18:35.552262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0521797f600144f4a5b5f844115029bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0521797f600144f4a5b5f844115029bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0521797f600144f4a5b5f844115029bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0521797f600144f4a5b5f844115029bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-VolumesSnapshotsTestJSON-345505235 Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 0521797f600144f4a5b5f844115029bb Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-345505235 Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-VolumesSnapshotsTestJSON-345505235-project Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 52eb4e92ccdf466a9c26a54a10313bbe Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-VolumesSnapshotsTestJSON-345505235-project Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '097ade2e-ec11-45d3-bf86-8480665e7fb6'} Jun 22 10:18:35.554750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. (HTTP 404) (Request-ID: req-1d8999d3-4bd0-4c4c-8c4a-563b5f374c8f) Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:35.555947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:18:35.557631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 10:18:35.559105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-40cb633f-1b50-4ca6-91de-86a0732a4d6f tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Returning 404 to user: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-40cb633f-1b50-4ca6-91de-86a0732a4d6f tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6" status: 404 len: 109 microversion: 2.1 time: 0.123761 Jun 22 10:18:35.560264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 16/36] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:35 2022] GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:18:35.565983 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0e3e97d9-dfb0-4c0f-9695-7d7350eae08f tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:35.565983 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0e3e97d9-dfb0-4c0f-9695-7d7350eae08f tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:35.581551 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0e3e97d9-dfb0-4c0f-9695-7d7350eae08f tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:35.590103 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0e3e97d9-dfb0-4c0f-9695-7d7350eae08f tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1215 microversion: 2.1 time: 0.180071 Jun 22 10:18:35.592277 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 17/37] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:35 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:35.608377 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-97db5805-f974-4b9d-8369-d72589b9d22a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:35.610313 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-97db5805-f974-4b9d-8369-d72589b9d22a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:35.722008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-97db5805-f974-4b9d-8369-d72589b9d22a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:35.729431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-97db5805-f974-4b9d-8369-d72589b9d22a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1222 microversion: 2.1 time: 0.135921 Jun 22 10:18:35.733674 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 18/38] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:35 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1222 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:35.747798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ea44eb18-7d5c-480f-ad06-187202cdf33b tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022c980d30>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:35.832892 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-ea44eb18-7d5c-480f-ad06-187202cdf33b tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] HTTP exception thrown: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ea44eb18-7d5c-480f-ad06-187202cdf33b tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Request method failure captured: Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: DELETE /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6 HTTP/1.1 Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisuxoAooBQRSw2dHBieayV_dNxth0R7xagtgTx6s-5syXGTahX0GOvYFKJilKao6wdTAkvVUQLEQObddSpZFAVsUSWASJkNh4NZiSe6AvrcVibs7VSgqkQ4pLxTWpqjMZMWfE-CJMwzRB8PR7vGUxyOT3-09nztxyLdl38nh4TV4DLKs Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 0521797f600144f4a5b5f844115029bb Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-345505235 Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:18:35.835242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0521797f600144f4a5b5f844115029bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0521797f600144f4a5b5f844115029bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0521797f600144f4a5b5f844115029bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0521797f600144f4a5b5f844115029bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-VolumesSnapshotsTestJSON-345505235 Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 0521797f600144f4a5b5f844115029bb Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-345505235 Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-VolumesSnapshotsTestJSON-345505235-project Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 52eb4e92ccdf466a9c26a54a10313bbe Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-VolumesSnapshotsTestJSON-345505235-project Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '097ade2e-ec11-45d3-bf86-8480665e7fb6'} Jun 22 10:18:35.845052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. (HTTP 404) (Request-ID: req-868ceaba-4282-475e-9a91-ceb96a8cd527) Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:35.846993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:18:35.847936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 10:18:35.849556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ea44eb18-7d5c-480f-ad06-187202cdf33b tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Returning 404 to user: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ea44eb18-7d5c-480f-ad06-187202cdf33b tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6" status: 404 len: 109 microversion: 2.1 time: 0.105443 Jun 22 10:18:35.852210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 19/39] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jun 22 10:18:35 2022] DELETE /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:18:35.856445 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6807f6be-3281-4a4f-8cd4-23b0a914ea76 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Calling method '.version_select at 0x7f022c98c160>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:35.945712 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-6807f6be-3281-4a4f-8cd4-23b0a914ea76 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] HTTP exception thrown: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6807f6be-3281-4a4f-8cd4-23b0a914ea76 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Request method failure captured: Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6 HTTP/1.1 Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisuxoAooBQRSw2dHBieayV_dNxth0R7xagtgTx6s-5syXGTahX0GOvYFKJilKao6wdTAkvVUQLEQObddSpZFAVsUSWASJkNh4NZiSe6AvrcVibs7VSgqkQ4pLxTWpqjMZMWfE-CJMwzRB8PR7vGUxyOT3-09nztxyLdl38nh4TV4DLKs Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 0521797f600144f4a5b5f844115029bb Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-345505235 Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:18:35.947902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0521797f600144f4a5b5f844115029bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_0521797f600144f4a5b5f844115029bb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/0521797f600144f4a5b5f844115029bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/0521797f600144f4a5b5f844115029bb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-VolumesSnapshotsTestJSON-345505235 Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 0521797f600144f4a5b5f844115029bb Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-345505235 Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-VolumesSnapshotsTestJSON-345505235-project Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 52eb4e92ccdf466a9c26a54a10313bbe Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-VolumesSnapshotsTestJSON-345505235-project Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '097ade2e-ec11-45d3-bf86-8480665e7fb6'} Jun 22 10:18:35.949011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. (HTTP 404) (Request-ID: req-d65dd174-ba26-4148-a3a2-10dcb479b0a2) Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:35.949699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:18:35.956749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 10:18:35.958155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6807f6be-3281-4a4f-8cd4-23b0a914ea76 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] Returning 404 to user: Volume 097ade2e-ec11-45d3-bf86-8480665e7fb6 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6807f6be-3281-4a4f-8cd4-23b0a914ea76 tempest-VolumesSnapshotsTestJSON-345505235 tempest-VolumesSnapshotsTestJSON-345505235-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6" status: 404 len: 109 microversion: 2.1 time: 0.105839 Jun 22 10:18:35.959104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 20/40] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:18:35 2022] GET /compute/v2.1/os-volumes/097ade2e-ec11-45d3-bf86-8480665e7fb6 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:18:36.030654 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b492b10b-1bfa-4f98-81d8-53fbadda83cc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Action: 'create', calling method: .version_select at 0x7f022d9d03a0>, body: {"keypair": {"name": "tempest-keypair-1547529637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInO9VAvmZPYw0y1C4BldcX13+eJXvuEb2WkXhMd49oCZlSi+9fC6w0aBLrstWgj5Vy9jV9sgKFcp9dzwzhNotWgmlI8stLxaRRuRpI6n0ZFygQs+1b2evK/A+vHea+oYQ=="}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:36.074547 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-b492b10b-1bfa-4f98-81d8-53fbadda83cc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Getting quotas for project 43383a4476d847f797dfb43fbfc66e42. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:18:36.079865 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-b492b10b-1bfa-4f98-81d8-53fbadda83cc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Getting quotas for user 16265c4e556943369aa0cb3e961795bb and project 43383a4476d847f797dfb43fbfc66e42. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:18:36.210264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b492b10b-1bfa-4f98-81d8-53fbadda83cc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.978538 Jun 22 10:18:36.219256 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jun 22 10:18:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:36.608342 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-184e80c4-f0af-4f17-a9e9-140646163919 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:36.609617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-184e80c4-f0af-4f17-a9e9-140646163919 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:36.906146 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-184e80c4-f0af-4f17-a9e9-140646163919 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:36.957504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-184e80c4-f0af-4f17-a9e9-140646163919 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1215 microversion: 2.1 time: 0.344382 Jun 22 10:18:36.975202 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 22/42] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:36 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1215 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:36.997876 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3fa94b13-62f7-43a0-b34b-505996b78e68 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:37.000756 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3fa94b13-62f7-43a0-b34b-505996b78e68 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:37.189719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3fa94b13-62f7-43a0-b34b-505996b78e68 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:37.201904 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3fa94b13-62f7-43a0-b34b-505996b78e68 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1222 microversion: 2.1 time: 0.221653 Jun 22 10:18:37.203065 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 23/43] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:36 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1222 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:37.871924 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-15a453c0-81f3-4d6b-b5f6-0a8afa1b8c3d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Action: 'create', calling method: .version_select at 0x7f022c980ee0>, body: {"keypair": {"name": "tempest-keypair-1886350199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfrs0CNJinO0mPNl+zAFvOeJ9hfCFjj26y9m2vs0PxzApokWvvgVlMI88EzGblVGm2x23P91/jUNUVuW1kmvm89vEVNB8OZLsS+PXoF7inLolxScAAWBx5GhtpqJXJ72g=="}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:37.926576 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-15a453c0-81f3-4d6b-b5f6-0a8afa1b8c3d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Getting quotas for project b3fed4f483e84ec7a10b96de33677cbc. Resources: {'key_pairs'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:18:37.930280 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-15a453c0-81f3-4d6b-b5f6-0a8afa1b8c3d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Getting quotas for user cef533d7373946dcb340fbf496070e9f and project b3fed4f483e84ec7a10b96de33677cbc. Resources: {'key_pairs'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:18:37.979151 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-82fbf893-1f50-4284-914a-f0617248d634 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:37.981047 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-82fbf893-1f50-4284-914a-f0617248d634 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:38.081846 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-15a453c0-81f3-4d6b-b5f6-0a8afa1b8c3d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.497409 Jun 22 10:18:38.081846 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 21/44] 10.222.0.46 () {62 vars in 1199 bytes} [Wed Jun 22 10:18:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1499 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 10:18:38.219925 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ab459a2d-3811-4c46-bee4-b581f7d10ead tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:38.220660 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ab459a2d-3811-4c46-bee4-b581f7d10ead tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:38.246998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab459a2d-3811-4c46-bee4-b581f7d10ead tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:38.251516 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab459a2d-3811-4c46-bee4-b581f7d10ead tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:38.260863 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab459a2d-3811-4c46-bee4-b581f7d10ead tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:38.263508 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab459a2d-3811-4c46-bee4-b581f7d10ead tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:38.450762 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-82fbf893-1f50-4284-914a-f0617248d634 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:38.465743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-82fbf893-1f50-4284-914a-f0617248d634 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1215 microversion: 2.1 time: 0.490777 Jun 22 10:18:38.467585 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 24/45] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:37 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1215 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:39.054176 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ab459a2d-3811-4c46-bee4-b581f7d10ead tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:39.093544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ab459a2d-3811-4c46-bee4-b581f7d10ead tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1274 microversion: 2.1 time: 0.873001 Jun 22 10:18:39.093544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 22/46] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:38 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1274 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:39.487754 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-916ea468-2758-4371-bc89-8a68a7115604 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:39.488377 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-916ea468-2758-4371-bc89-8a68a7115604 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:39.538586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-916ea468-2758-4371-bc89-8a68a7115604 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:39.546424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-916ea468-2758-4371-bc89-8a68a7115604 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:39.553701 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-916ea468-2758-4371-bc89-8a68a7115604 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:39.558774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-916ea468-2758-4371-bc89-8a68a7115604 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:40.109195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1578b252-4ef5-4c20-b52e-eaa10fb834bd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:40.111282 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1578b252-4ef5-4c20-b52e-eaa10fb834bd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:40.136513 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1578b252-4ef5-4c20-b52e-eaa10fb834bd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:40.138863 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1578b252-4ef5-4c20-b52e-eaa10fb834bd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:40.148951 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1578b252-4ef5-4c20-b52e-eaa10fb834bd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:40.149572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1578b252-4ef5-4c20-b52e-eaa10fb834bd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:40.811719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-916ea468-2758-4371-bc89-8a68a7115604 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:40.849174 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-916ea468-2758-4371-bc89-8a68a7115604 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1219 microversion: 2.1 time: 1.369401 Jun 22 10:18:40.857349 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 25/47] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:39 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1219 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:40.871513 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1578b252-4ef5-4c20-b52e-eaa10fb834bd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:40.885471 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1578b252-4ef5-4c20-b52e-eaa10fb834bd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1280 microversion: 2.1 time: 0.780765 Jun 22 10:18:40.889150 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 23/48] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:40 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1280 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:41.869172 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e79ffead-2416-41b0-b3e1-53bb11bcc18b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:41.872158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e79ffead-2416-41b0-b3e1-53bb11bcc18b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:41.886120 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e79ffead-2416-41b0-b3e1-53bb11bcc18b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.887913 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e79ffead-2416-41b0-b3e1-53bb11bcc18b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:41.893528 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e79ffead-2416-41b0-b3e1-53bb11bcc18b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.895611 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e79ffead-2416-41b0-b3e1-53bb11bcc18b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:41.905366 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-674cb49b-6287-4acb-b9f6-7a724efafa9b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:41.907677 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-674cb49b-6287-4acb-b9f6-7a724efafa9b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:41.939406 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-674cb49b-6287-4acb-b9f6-7a724efafa9b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.944663 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-674cb49b-6287-4acb-b9f6-7a724efafa9b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:41.950119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-674cb49b-6287-4acb-b9f6-7a724efafa9b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.953512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-674cb49b-6287-4acb-b9f6-7a724efafa9b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:42.265900 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e79ffead-2416-41b0-b3e1-53bb11bcc18b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:42.304259 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e79ffead-2416-41b0-b3e1-53bb11bcc18b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1273 microversion: 2.1 time: 0.439138 Jun 22 10:18:42.313180 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 26/49] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:41 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1273 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:42.598724 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-674cb49b-6287-4acb-b9f6-7a724efafa9b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:42.611578 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-674cb49b-6287-4acb-b9f6-7a724efafa9b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1280 microversion: 2.1 time: 0.711614 Jun 22 10:18:42.615610 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 24/50] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:41 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1280 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:42.889933 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-454428652", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72f50f25-07f0-4518-92c4-2de857dd3884"}], "security_groups": [{"name": "tempest-securitygroup--1102444478"}], "key_name": "tempest-keypair-1547529637", "user_data": "}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:43.328850 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b8d4ec27-60ce-4879-8356-99fedf385e0f tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:43.329467 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b8d4ec27-60ce-4879-8356-99fedf385e0f tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:43.348072 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b8d4ec27-60ce-4879-8356-99fedf385e0f tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:43.348573 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b8d4ec27-60ce-4879-8356-99fedf385e0f tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:43.354366 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b8d4ec27-60ce-4879-8356-99fedf385e0f tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:43.356182 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b8d4ec27-60ce-4879-8356-99fedf385e0f tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:43.775168 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b8d4ec27-60ce-4879-8356-99fedf385e0f tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:43.786526 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b8d4ec27-60ce-4879-8356-99fedf385e0f tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1273 microversion: 2.1 time: 0.458932 Jun 22 10:18:43.787358 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 25/51] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:43 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1273 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:43.801605 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9fed86d6-cf0f-4e1f-b4d2-73125e68527c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:43.804984 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9fed86d6-cf0f-4e1f-b4d2-73125e68527c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:43.828515 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9fed86d6-cf0f-4e1f-b4d2-73125e68527c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:43.835912 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9fed86d6-cf0f-4e1f-b4d2-73125e68527c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:43.839845 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9fed86d6-cf0f-4e1f-b4d2-73125e68527c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:43.839845 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9fed86d6-cf0f-4e1f-b4d2-73125e68527c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:43.896057 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.network.neutron [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] validate_networks() for [('72f50f25-07f0-4518-92c4-2de857dd3884', None, None, None, None, None)] {{(pid=118326) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:18:44.089155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9fed86d6-cf0f-4e1f-b4d2-73125e68527c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:44.106129 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9fed86d6-cf0f-4e1f-b4d2-73125e68527c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1280 microversion: 2.1 time: 0.314231 Jun 22 10:18:44.109393 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 26/52] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:43 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1280 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:44.803713 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:44.808228 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9662fb01-93ce-442e-9158-c1637e1401ea tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:44.808914 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9662fb01-93ce-442e-9158-c1637e1401ea tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:44.829114 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9662fb01-93ce-442e-9158-c1637e1401ea tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:44.829114 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9662fb01-93ce-442e-9158-c1637e1401ea tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:44.829114 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9662fb01-93ce-442e-9158-c1637e1401ea tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:44.829891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9662fb01-93ce-442e-9158-c1637e1401ea tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:45.090178 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=4 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:46.513503 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9662fb01-93ce-442e-9158-c1637e1401ea tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:46.529507 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9662fb01-93ce-442e-9158-c1637e1401ea tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 1.728975 Jun 22 10:18:46.530637 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 27/53] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:44 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:46.559928 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bab13191-aa4e-41a3-8803-ab15e12fcac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:46.560778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bab13191-aa4e-41a3-8803-ab15e12fcac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:46.569492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bab13191-aa4e-41a3-8803-ab15e12fcac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:46.570209 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bab13191-aa4e-41a3-8803-ab15e12fcac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:46.571286 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bab13191-aa4e-41a3-8803-ab15e12fcac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:46.571889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bab13191-aa4e-41a3-8803-ab15e12fcac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:47.939991 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=22 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:48.146408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bab13191-aa4e-41a3-8803-ab15e12fcac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:48.167393 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bab13191-aa4e-41a3-8803-ab15e12fcac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 1.617587 Jun 22 10:18:48.170474 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 28/54] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:46 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:48.191651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-824413809", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5b06f66-fceb-42a0-91a2-b45c69aaa8d7"}], "security_groups": [{"name": "tempest-securitygroup--2031323461"}], "key_name": "tempest-keypair-1886350199", "user_data": "}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:48.417922 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Flavor limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:18:48.418415 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Image limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:18:48.420010 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Flavor pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:18:48.420010 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Image pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:18:48.420010 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:18:48.450166 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:48.451513 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:48.451974 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:48.466301 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:48.504022 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Getting quotas for project 43383a4476d847f797dfb43fbfc66e42. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:18:48.515367 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Getting quotas for user 16265c4e556943369aa0cb3e961795bb and project 43383a4476d847f797dfb43fbfc66e42. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:18:48.543640 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Going to run 1 instances... {{(pid=118326) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:18:48.546107 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118326) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:18:48.655999 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.network.neutron [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] validate_networks() for [('c5b06f66-fceb-42a0-91a2-b45c69aaa8d7', None, None, None, None, None)] {{(pid=118327) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:18:48.731423 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-29be6d06-26ba-4c15-a447-031bfabe2fae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.854117 Jun 22 10:18:48.732994 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 27/55] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:18:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 5857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:18:48.738616 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a4ca6e67-4b8d-4bc4-b20b-a44efe88271c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:48.739457 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a4ca6e67-4b8d-4bc4-b20b-a44efe88271c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:48.748628 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a4ca6e67-4b8d-4bc4-b20b-a44efe88271c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:48.749366 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a4ca6e67-4b8d-4bc4-b20b-a44efe88271c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:48.750544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a4ca6e67-4b8d-4bc4-b20b-a44efe88271c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:48.751981 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a4ca6e67-4b8d-4bc4-b20b-a44efe88271c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:49.632088 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a4ca6e67-4b8d-4bc4-b20b-a44efe88271c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:49.645042 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a4ca6e67-4b8d-4bc4-b20b-a44efe88271c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.908150 Jun 22 10:18:49.657393 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 28/56] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:48 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:49.672276 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-be885087-dce9-45e0-8002-220db20accf7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:49.672276 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-be885087-dce9-45e0-8002-220db20accf7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:50.098932 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-be885087-dce9-45e0-8002-220db20accf7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:50.107209 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-be885087-dce9-45e0-8002-220db20accf7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1237 microversion: 2.1 time: 0.447695 Jun 22 10:18:50.115048 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 29/57] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:49 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1237 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:50.117815 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ff464965-f6c0-48df-9fd9-e5137ed3748f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:50.118462 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ff464965-f6c0-48df-9fd9-e5137ed3748f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:50.130847 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ff464965-f6c0-48df-9fd9-e5137ed3748f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:50.137782 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ff464965-f6c0-48df-9fd9-e5137ed3748f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:50.139164 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ff464965-f6c0-48df-9fd9-e5137ed3748f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:50.139656 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ff464965-f6c0-48df-9fd9-e5137ed3748f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.214435 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Flavor limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:18:51.215552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Image limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:18:51.217767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Flavor pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:18:51.219147 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Image pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:18:51.219764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:18:51.238454 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.241626 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.242764 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ff464965-f6c0-48df-9fd9-e5137ed3748f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:51.247858 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.248750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.258230 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ff464965-f6c0-48df-9fd9-e5137ed3748f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 1.147158 Jun 22 10:18:51.258866 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 30/58] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:50 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:51.263905 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4eecff4d-2742-457c-bacd-b6aa15efe38b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:51.273748 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4eecff4d-2742-457c-bacd-b6aa15efe38b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:51.294282 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4eecff4d-2742-457c-bacd-b6aa15efe38b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.299519 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4eecff4d-2742-457c-bacd-b6aa15efe38b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.301793 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4eecff4d-2742-457c-bacd-b6aa15efe38b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.302596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4eecff4d-2742-457c-bacd-b6aa15efe38b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.309327 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Getting quotas for project b3fed4f483e84ec7a10b96de33677cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:18:51.318250 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Getting quotas for user cef533d7373946dcb340fbf496070e9f and project b3fed4f483e84ec7a10b96de33677cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:18:51.358410 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Going to run 1 instances... {{(pid=118327) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:18:51.358410 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:18:51.572762 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-09bd1bbc-982a-4028-aeac-ff127d2cdf29 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.397640 Jun 22 10:18:51.578086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 29/59] 10.222.0.46 () {62 vars in 1187 bytes} [Wed Jun 22 10:18:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 3407 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 10:18:51.791606 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-76896d91-0091-4c18-9152-f73adfaf70be req-a6f7eaa6-77de-49eb-93f9-8c9865701975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398fb416-b4c6-4b43-80be-683e1a41721b", "tag": "5e03fdc7-3edb-469a-871f-db5cfb33c5e3"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:51.824275 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-76896d91-0091-4c18-9152-f73adfaf70be req-a6f7eaa6-77de-49eb-93f9-8c9865701975 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.824275 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-76896d91-0091-4c18-9152-f73adfaf70be req-a6f7eaa6-77de-49eb-93f9-8c9865701975 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.842766 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-76896d91-0091-4c18-9152-f73adfaf70be req-a6f7eaa6-77de-49eb-93f9-8c9865701975 service nova] Creating event network-changed:5e03fdc7-3edb-469a-871f-db5cfb33c5e3 for instance 398fb416-b4c6-4b43-80be-683e1a41721b on hv-cinder-84327 Jun 22 10:18:51.843551 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-76896d91-0091-4c18-9152-f73adfaf70be req-a6f7eaa6-77de-49eb-93f9-8c9865701975 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 10:18:51.844907 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e2ab3307-69b0-445c-afcf-5010eed04fbc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.849760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e2ab3307-69b0-445c-afcf-5010eed04fbc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.849760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e2ab3307-69b0-445c-afcf-5010eed04fbc None None] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.849760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e2ab3307-69b0-445c-afcf-5010eed04fbc None None] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.881371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4eecff4d-2742-457c-bacd-b6aa15efe38b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:51.887964 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.compute.rpcapi [None req-e2ab3307-69b0-445c-afcf-5010eed04fbc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 10:18:51.888916 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e2ab3307-69b0-445c-afcf-5010eed04fbc None None] Releasing lock "compute-rpcapi-router" {{(pid=118327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 10:18:51.894452 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4eecff4d-2742-457c-bacd-b6aa15efe38b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.634226 Jun 22 10:18:51.895352 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 31/60] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:51 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:51.903600 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6eb3bd93-ad77-4a45-82d5-ea2967a1f358 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:51.905164 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6eb3bd93-ad77-4a45-82d5-ea2967a1f358 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:51.935130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6eb3bd93-ad77-4a45-82d5-ea2967a1f358 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.935130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6eb3bd93-ad77-4a45-82d5-ea2967a1f358 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.935130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6eb3bd93-ad77-4a45-82d5-ea2967a1f358 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.935130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6eb3bd93-ad77-4a45-82d5-ea2967a1f358 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.941959 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e2ab3307-69b0-445c-afcf-5010eed04fbc None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.362205 Jun 22 10:18:51.942808 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 30/61] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:51.972092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c4d5af09-9ea0-4ee6-bf32-5af263552113 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:51.979986 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c4d5af09-9ea0-4ee6-bf32-5af263552113 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:52.223607 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c4d5af09-9ea0-4ee6-bf32-5af263552113 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:52.224529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6eb3bd93-ad77-4a45-82d5-ea2967a1f358 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:52.233896 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c4d5af09-9ea0-4ee6-bf32-5af263552113 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:52.236373 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c4d5af09-9ea0-4ee6-bf32-5af263552113 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:52.239388 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c4d5af09-9ea0-4ee6-bf32-5af263552113 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1281 microversion: 2.20 time: 0.295369 Jun 22 10:18:52.250134 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 31/62] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:51 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1281 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:52.270881 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6eb3bd93-ad77-4a45-82d5-ea2967a1f358 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1233 microversion: 2.1 time: 0.369365 Jun 22 10:18:52.271526 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 32/63] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:51 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1233 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:52.278468 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c26e840d-06fe-47e8-985e-aa0a5844a0ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:52.279417 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c26e840d-06fe-47e8-985e-aa0a5844a0ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:52.302105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c26e840d-06fe-47e8-985e-aa0a5844a0ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:52.302841 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c26e840d-06fe-47e8-985e-aa0a5844a0ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:52.303793 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c26e840d-06fe-47e8-985e-aa0a5844a0ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:52.304538 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c26e840d-06fe-47e8-985e-aa0a5844a0ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:52.501419 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c26e840d-06fe-47e8-985e-aa0a5844a0ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:52.510410 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c26e840d-06fe-47e8-985e-aa0a5844a0ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.235811 Jun 22 10:18:52.511187 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 32/64] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:52 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:52.911842 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4bf1a187-3928-4607-b30c-a9fa5633b42e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:52.912398 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4bf1a187-3928-4607-b30c-a9fa5633b42e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:52.918594 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4bf1a187-3928-4607-b30c-a9fa5633b42e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:52.919049 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4bf1a187-3928-4607-b30c-a9fa5633b42e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:52.920177 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4bf1a187-3928-4607-b30c-a9fa5633b42e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:52.920618 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4bf1a187-3928-4607-b30c-a9fa5633b42e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:53.073317 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4bf1a187-3928-4607-b30c-a9fa5633b42e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:53.081502 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4bf1a187-3928-4607-b30c-a9fa5633b42e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.174171 Jun 22 10:18:53.082081 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 33/65] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:52 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:53.259650 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4d9abd03-f712-4478-ad05-cf5a4bda8168 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:53.260268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4d9abd03-f712-4478-ad05-cf5a4bda8168 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:53.266357 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d9abd03-f712-4478-ad05-cf5a4bda8168 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.267617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d9abd03-f712-4478-ad05-cf5a4bda8168 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:53.268389 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d9abd03-f712-4478-ad05-cf5a4bda8168 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.268839 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d9abd03-f712-4478-ad05-cf5a4bda8168 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:53.287382 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-13cf68b8-396a-4c69-a887-861fc66f3f6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:53.287989 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-13cf68b8-396a-4c69-a887-861fc66f3f6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:53.293969 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-13cf68b8-396a-4c69-a887-861fc66f3f6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.294415 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-13cf68b8-396a-4c69-a887-861fc66f3f6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:53.295169 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-13cf68b8-396a-4c69-a887-861fc66f3f6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.295604 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-13cf68b8-396a-4c69-a887-861fc66f3f6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:53.333706 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4d9abd03-f712-4478-ad05-cf5a4bda8168 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:53.341659 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4d9abd03-f712-4478-ad05-cf5a4bda8168 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:53.343167 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4d9abd03-f712-4478-ad05-cf5a4bda8168 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:53.344279 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4d9abd03-f712-4478-ad05-cf5a4bda8168 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1285 microversion: 2.20 time: 0.088556 Jun 22 10:18:53.344864 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 33/66] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:53 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:53.363991 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-13cf68b8-396a-4c69-a887-861fc66f3f6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:53.371519 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-13cf68b8-396a-4c69-a887-861fc66f3f6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1233 microversion: 2.1 time: 0.087865 Jun 22 10:18:53.372094 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 34/67] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:53 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:53.527625 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1ff28aea-32a6-4e85-83b8-82a9fee7d5c7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:53.528018 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1ff28aea-32a6-4e85-83b8-82a9fee7d5c7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:53.530992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:53.534389 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1ff28aea-32a6-4e85-83b8-82a9fee7d5c7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.534825 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1ff28aea-32a6-4e85-83b8-82a9fee7d5c7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:53.535602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1ff28aea-32a6-4e85-83b8-82a9fee7d5c7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.536031 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1ff28aea-32a6-4e85-83b8-82a9fee7d5c7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:53.669364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1ff28aea-32a6-4e85-83b8-82a9fee7d5c7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:53.677141 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1ff28aea-32a6-4e85-83b8-82a9fee7d5c7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.153553 Jun 22 10:18:53.677710 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 34/68] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:53 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:53.980171 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-27aa9f14-7c50-461b-b354-9765deaa0670 req-7eac7b3b-2cea-469c-9a9c-6114e4f38853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8701ce7d-38d6-4383-9491-e2d4740a2f5f", "tag": "39ba7490-4bda-4946-a369-308acdb5baa3"}, {"name": "network-changed", "server_uuid": "c2acd1a7-4078-4955-ab65-12d905064011", "tag": "e9e20178-585d-42d5-a786-c8d8f9ddf6d7"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:53.992241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-27aa9f14-7c50-461b-b354-9765deaa0670 req-7eac7b3b-2cea-469c-9a9c-6114e4f38853 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.992683 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-27aa9f14-7c50-461b-b354-9765deaa0670 req-7eac7b3b-2cea-469c-9a9c-6114e4f38853 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.014053 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-27aa9f14-7c50-461b-b354-9765deaa0670 req-7eac7b3b-2cea-469c-9a9c-6114e4f38853 service nova] Creating event network-changed:39ba7490-4bda-4946-a369-308acdb5baa3 for instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f on hv-cinder-84327 Jun 22 10:18:54.014567 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-27aa9f14-7c50-461b-b354-9765deaa0670 req-7eac7b3b-2cea-469c-9a9c-6114e4f38853 service nova] Creating event network-changed:e9e20178-585d-42d5-a786-c8d8f9ddf6d7 for instance c2acd1a7-4078-4955-ab65-12d905064011 on hv-cinder-84327 Jun 22 10:18:54.015105 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-27aa9f14-7c50-461b-b354-9765deaa0670 req-7eac7b3b-2cea-469c-9a9c-6114e4f38853 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118326) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 10:18:54.016203 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0123fae7-55bc-4ab6-b080-c25073657cfc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.016649 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0123fae7-55bc-4ab6-b080-c25073657cfc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.018304 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0123fae7-55bc-4ab6-b080-c25073657cfc None None] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.018743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0123fae7-55bc-4ab6-b080-c25073657cfc None None] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.027265 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.compute.rpcapi [None req-0123fae7-55bc-4ab6-b080-c25073657cfc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 10:18:54.028174 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0123fae7-55bc-4ab6-b080-c25073657cfc None None] Releasing lock "compute-rpcapi-router" {{(pid=118326) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 10:18:54.045103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0123fae7-55bc-4ab6-b080-c25073657cfc None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.068869 Jun 22 10:18:54.045706 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 35/69] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:54.098226 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d66cfe5c-c3d5-4c86-9457-6f48f5b9c189 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:54.098981 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d66cfe5c-c3d5-4c86-9457-6f48f5b9c189 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:54.105564 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d66cfe5c-c3d5-4c86-9457-6f48f5b9c189 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.106088 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d66cfe5c-c3d5-4c86-9457-6f48f5b9c189 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.107120 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d66cfe5c-c3d5-4c86-9457-6f48f5b9c189 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.107620 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d66cfe5c-c3d5-4c86-9457-6f48f5b9c189 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.245759 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d66cfe5c-c3d5-4c86-9457-6f48f5b9c189 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:54.254068 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d66cfe5c-c3d5-4c86-9457-6f48f5b9c189 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.159562 Jun 22 10:18:54.254916 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 35/70] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:54 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:54.363592 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2bbcea4e-93be-4653-bd13-ab908177cf0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:54.364298 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2bbcea4e-93be-4653-bd13-ab908177cf0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:54.372985 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2bbcea4e-93be-4653-bd13-ab908177cf0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.373440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2bbcea4e-93be-4653-bd13-ab908177cf0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.374203 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2bbcea4e-93be-4653-bd13-ab908177cf0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.374633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2bbcea4e-93be-4653-bd13-ab908177cf0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.388901 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-74762f24-8355-4a62-97bf-003dadb63a6f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:54.390021 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-74762f24-8355-4a62-97bf-003dadb63a6f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:54.396032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-74762f24-8355-4a62-97bf-003dadb63a6f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.396398 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-74762f24-8355-4a62-97bf-003dadb63a6f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.397220 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-74762f24-8355-4a62-97bf-003dadb63a6f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.397643 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-74762f24-8355-4a62-97bf-003dadb63a6f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.442012 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2bbcea4e-93be-4653-bd13-ab908177cf0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:54.450361 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2bbcea4e-93be-4653-bd13-ab908177cf0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:54.451806 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2bbcea4e-93be-4653-bd13-ab908177cf0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:54.453008 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2bbcea4e-93be-4653-bd13-ab908177cf0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1285 microversion: 2.20 time: 0.094239 Jun 22 10:18:54.453575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 36/71] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:54 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:54.467684 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-74762f24-8355-4a62-97bf-003dadb63a6f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:54.475188 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-74762f24-8355-4a62-97bf-003dadb63a6f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1233 microversion: 2.1 time: 0.090396 Jun 22 10:18:54.475755 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 36/72] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:54 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:54.694419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f7a32907-82e5-4086-b924-6f7632dd7441 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:54.699389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f7a32907-82e5-4086-b924-6f7632dd7441 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:54.701173 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f7a32907-82e5-4086-b924-6f7632dd7441 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.701573 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f7a32907-82e5-4086-b924-6f7632dd7441 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.702388 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f7a32907-82e5-4086-b924-6f7632dd7441 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.702824 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f7a32907-82e5-4086-b924-6f7632dd7441 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.830882 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f7a32907-82e5-4086-b924-6f7632dd7441 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:54.838401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f7a32907-82e5-4086-b924-6f7632dd7441 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.147837 Jun 22 10:18:54.838969 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 37/73] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:54 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:55.271857 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-279cac19-73d4-40d1-b998-6f46a006f427 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:55.273075 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-279cac19-73d4-40d1-b998-6f46a006f427 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:55.279922 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-279cac19-73d4-40d1-b998-6f46a006f427 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.280575 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-279cac19-73d4-40d1-b998-6f46a006f427 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:55.281683 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-279cac19-73d4-40d1-b998-6f46a006f427 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.282988 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-279cac19-73d4-40d1-b998-6f46a006f427 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:55.455744 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-279cac19-73d4-40d1-b998-6f46a006f427 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:55.464213 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-279cac19-73d4-40d1-b998-6f46a006f427 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.197026 Jun 22 10:18:55.466586 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 37/74] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:55 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:55.473384 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-080f16f5-06eb-4f9a-8c4c-eba55a51468f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:55.474695 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-080f16f5-06eb-4f9a-8c4c-eba55a51468f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:55.486581 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-080f16f5-06eb-4f9a-8c4c-eba55a51468f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.486581 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-080f16f5-06eb-4f9a-8c4c-eba55a51468f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:55.486581 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-080f16f5-06eb-4f9a-8c4c-eba55a51468f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.486581 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-080f16f5-06eb-4f9a-8c4c-eba55a51468f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:55.492073 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a048b562-0b41-45b6-b261-e3a98c9d9bf0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:55.492921 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a048b562-0b41-45b6-b261-e3a98c9d9bf0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:55.499220 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a048b562-0b41-45b6-b261-e3a98c9d9bf0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.499826 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a048b562-0b41-45b6-b261-e3a98c9d9bf0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:55.500873 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a048b562-0b41-45b6-b261-e3a98c9d9bf0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.501489 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a048b562-0b41-45b6-b261-e3a98c9d9bf0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:55.568143 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-080f16f5-06eb-4f9a-8c4c-eba55a51468f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:55.576672 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-080f16f5-06eb-4f9a-8c4c-eba55a51468f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:55.578363 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-080f16f5-06eb-4f9a-8c4c-eba55a51468f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:55.579653 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-080f16f5-06eb-4f9a-8c4c-eba55a51468f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1285 microversion: 2.20 time: 0.111081 Jun 22 10:18:55.590693 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 38/75] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:55 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:55.591012 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a048b562-0b41-45b6-b261-e3a98c9d9bf0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:55.598359 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a048b562-0b41-45b6-b261-e3a98c9d9bf0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1233 microversion: 2.1 time: 0.109957 Jun 22 10:18:55.603430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 38/76] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:55 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1233 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:55.854583 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e9e32fc7-d409-4628-8ff5-9bfc008e0317 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:55.855199 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e9e32fc7-d409-4628-8ff5-9bfc008e0317 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:55.861316 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e9e32fc7-d409-4628-8ff5-9bfc008e0317 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.861771 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e9e32fc7-d409-4628-8ff5-9bfc008e0317 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:55.862871 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e9e32fc7-d409-4628-8ff5-9bfc008e0317 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.863254 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e9e32fc7-d409-4628-8ff5-9bfc008e0317 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:56.000866 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e9e32fc7-d409-4628-8ff5-9bfc008e0317 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:56.011286 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e9e32fc7-d409-4628-8ff5-9bfc008e0317 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.160050 Jun 22 10:18:56.017234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 39/77] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:55 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:56.482749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-71a2a0da-598a-4378-bb70-504f49bf23fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:56.483338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-71a2a0da-598a-4378-bb70-504f49bf23fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:56.489954 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71a2a0da-598a-4378-bb70-504f49bf23fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:56.490351 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71a2a0da-598a-4378-bb70-504f49bf23fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:56.491158 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71a2a0da-598a-4378-bb70-504f49bf23fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:56.491591 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71a2a0da-598a-4378-bb70-504f49bf23fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:56.598263 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d72bc97d-de87-4d96-bc80-8939ee528d64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:56.605699 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d72bc97d-de87-4d96-bc80-8939ee528d64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:56.605699 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d72bc97d-de87-4d96-bc80-8939ee528d64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:56.605699 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d72bc97d-de87-4d96-bc80-8939ee528d64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:56.606117 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d72bc97d-de87-4d96-bc80-8939ee528d64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:56.606559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d72bc97d-de87-4d96-bc80-8939ee528d64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:56.623218 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-71a2a0da-598a-4378-bb70-504f49bf23fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:56.627802 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:56.631524 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-71a2a0da-598a-4378-bb70-504f49bf23fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.152784 Jun 22 10:18:56.632096 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 39/78] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:56 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:56.636758 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cf20b8b5-e593-4846-983b-8cdd6dcdefee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:56.637396 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-cf20b8b5-e593-4846-983b-8cdd6dcdefee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:56.643818 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cf20b8b5-e593-4846-983b-8cdd6dcdefee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:56.644266 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cf20b8b5-e593-4846-983b-8cdd6dcdefee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:56.645058 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cf20b8b5-e593-4846-983b-8cdd6dcdefee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:56.645494 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cf20b8b5-e593-4846-983b-8cdd6dcdefee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:56.668068 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d72bc97d-de87-4d96-bc80-8939ee528d64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:56.677105 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d72bc97d-de87-4d96-bc80-8939ee528d64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:56.678578 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d72bc97d-de87-4d96-bc80-8939ee528d64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:56.679709 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d72bc97d-de87-4d96-bc80-8939ee528d64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1285 microversion: 2.20 time: 0.085435 Jun 22 10:18:56.680263 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 40/79] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:56 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:56.711634 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cf20b8b5-e593-4846-983b-8cdd6dcdefee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:56.719070 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cf20b8b5-e593-4846-983b-8cdd6dcdefee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1233 microversion: 2.1 time: 0.086010 Jun 22 10:18:56.719676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 40/80] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:56 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:57.029506 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-014e56da-d404-41ae-9a83-8e0a79af4ef4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:57.030458 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-014e56da-d404-41ae-9a83-8e0a79af4ef4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:57.039069 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-014e56da-d404-41ae-9a83-8e0a79af4ef4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:57.041034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-014e56da-d404-41ae-9a83-8e0a79af4ef4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:57.041034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-014e56da-d404-41ae-9a83-8e0a79af4ef4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:57.041034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-014e56da-d404-41ae-9a83-8e0a79af4ef4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:57.187040 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-014e56da-d404-41ae-9a83-8e0a79af4ef4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:57.195257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-014e56da-d404-41ae-9a83-8e0a79af4ef4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.169791 Jun 22 10:18:57.196187 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 41/81] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:57 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:57.648811 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1bf7e798-265b-4f7b-9ec9-02bfbd8c8732 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:57.649490 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1bf7e798-265b-4f7b-9ec9-02bfbd8c8732 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:57.655653 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1bf7e798-265b-4f7b-9ec9-02bfbd8c8732 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:57.656150 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1bf7e798-265b-4f7b-9ec9-02bfbd8c8732 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:57.657071 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1bf7e798-265b-4f7b-9ec9-02bfbd8c8732 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:57.657552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1bf7e798-265b-4f7b-9ec9-02bfbd8c8732 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:57.698932 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7d836b53-5b31-4d73-a980-ba31804fd1e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:57.699586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7d836b53-5b31-4d73-a980-ba31804fd1e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:57.707974 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7d836b53-5b31-4d73-a980-ba31804fd1e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:57.708339 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7d836b53-5b31-4d73-a980-ba31804fd1e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:57.709173 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7d836b53-5b31-4d73-a980-ba31804fd1e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:57.709798 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7d836b53-5b31-4d73-a980-ba31804fd1e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:57.815097 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7d836b53-5b31-4d73-a980-ba31804fd1e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:57.826435 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7d836b53-5b31-4d73-a980-ba31804fd1e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:57.828450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7d836b53-5b31-4d73-a980-ba31804fd1e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:57.830639 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7d836b53-5b31-4d73-a980-ba31804fd1e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1285 microversion: 2.20 time: 0.136607 Jun 22 10:18:57.831210 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 42/82] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:57 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:57.836366 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-abf5917a-e860-437b-ac1a-5a5dcd4e82c5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:57.838559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-abf5917a-e860-437b-ac1a-5a5dcd4e82c5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:57.840949 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1bf7e798-265b-4f7b-9ec9-02bfbd8c8732 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:57.844198 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-abf5917a-e860-437b-ac1a-5a5dcd4e82c5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:57.844732 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-abf5917a-e860-437b-ac1a-5a5dcd4e82c5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:57.845772 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-abf5917a-e860-437b-ac1a-5a5dcd4e82c5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:57.846315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-abf5917a-e860-437b-ac1a-5a5dcd4e82c5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:57.850817 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1bf7e798-265b-4f7b-9ec9-02bfbd8c8732 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.205609 Jun 22 10:18:57.851662 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:57.860177 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 41/83] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:57 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:58.093444 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-abf5917a-e860-437b-ac1a-5a5dcd4e82c5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:58.101417 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-abf5917a-e860-437b-ac1a-5a5dcd4e82c5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1233 microversion: 2.1 time: 0.268973 Jun 22 10:18:58.102188 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 43/84] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:57 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1233 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:58.212644 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e77ef32e-b9bc-45af-8244-7af3d2021952 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:58.213343 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e77ef32e-b9bc-45af-8244-7af3d2021952 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:58.219456 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e77ef32e-b9bc-45af-8244-7af3d2021952 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:58.219916 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e77ef32e-b9bc-45af-8244-7af3d2021952 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:58.220688 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e77ef32e-b9bc-45af-8244-7af3d2021952 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:58.224065 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e77ef32e-b9bc-45af-8244-7af3d2021952 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:58.362009 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-e77ef32e-b9bc-45af-8244-7af3d2021952 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:58.369585 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e77ef32e-b9bc-45af-8244-7af3d2021952 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.160790 Jun 22 10:18:58.370160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 42/85] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:58 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:58.849170 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d24fe721-61ce-4832-8d23-99a94eb8ad41 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:58.849961 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d24fe721-61ce-4832-8d23-99a94eb8ad41 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:58.856181 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:58.857987 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d24fe721-61ce-4832-8d23-99a94eb8ad41 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:58.858502 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d24fe721-61ce-4832-8d23-99a94eb8ad41 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:58.859442 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d24fe721-61ce-4832-8d23-99a94eb8ad41 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:58.860021 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d24fe721-61ce-4832-8d23-99a94eb8ad41 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:58.867781 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f6be2b81-76f4-42aa-beed-7576b36433fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:58.868394 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f6be2b81-76f4-42aa-beed-7576b36433fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:58.878750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f6be2b81-76f4-42aa-beed-7576b36433fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:58.881439 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f6be2b81-76f4-42aa-beed-7576b36433fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:58.882621 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f6be2b81-76f4-42aa-beed-7576b36433fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:58.883069 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f6be2b81-76f4-42aa-beed-7576b36433fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:58.985638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d24fe721-61ce-4832-8d23-99a94eb8ad41 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:59.004425 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d24fe721-61ce-4832-8d23-99a94eb8ad41 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:59.006480 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d24fe721-61ce-4832-8d23-99a94eb8ad41 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:59.008019 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d24fe721-61ce-4832-8d23-99a94eb8ad41 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1285 microversion: 2.20 time: 0.163554 Jun 22 10:18:59.008611 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 44/86] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:58 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:59.120712 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ff42733b-f112-4078-9dd1-3fb5ca852027 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:59.120712 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ff42733b-f112-4078-9dd1-3fb5ca852027 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:59.127046 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ff42733b-f112-4078-9dd1-3fb5ca852027 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:59.127489 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ff42733b-f112-4078-9dd1-3fb5ca852027 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:59.128258 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ff42733b-f112-4078-9dd1-3fb5ca852027 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:59.128946 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ff42733b-f112-4078-9dd1-3fb5ca852027 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:59.293433 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ff42733b-f112-4078-9dd1-3fb5ca852027 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:59.302523 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ff42733b-f112-4078-9dd1-3fb5ca852027 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1233 microversion: 2.1 time: 0.187308 Jun 22 10:18:59.303915 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 45/87] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:59 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1233 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:59.386942 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bce863e1-8de9-4f30-9e4a-b4a23357dfce tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:59.387766 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bce863e1-8de9-4f30-9e4a-b4a23357dfce tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:59.394533 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bce863e1-8de9-4f30-9e4a-b4a23357dfce tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:59.395066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bce863e1-8de9-4f30-9e4a-b4a23357dfce tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:59.395738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bce863e1-8de9-4f30-9e4a-b4a23357dfce tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:59.396171 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bce863e1-8de9-4f30-9e4a-b4a23357dfce tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:59.447953 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f6be2b81-76f4-42aa-beed-7576b36433fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:59.455791 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f6be2b81-76f4-42aa-beed-7576b36433fb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.592159 Jun 22 10:18:59.456379 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 43/88] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:58 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:59.614958 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bce863e1-8de9-4f30-9e4a-b4a23357dfce tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:59.622842 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bce863e1-8de9-4f30-9e4a-b4a23357dfce tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.240008 Jun 22 10:18:59.623414 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 46/89] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:59 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:00.026959 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6c59afe0-be0e-435e-b902-8b1946646d4f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:00.027732 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6c59afe0-be0e-435e-b902-8b1946646d4f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:00.033903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c59afe0-be0e-435e-b902-8b1946646d4f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.034491 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c59afe0-be0e-435e-b902-8b1946646d4f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.035271 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c59afe0-be0e-435e-b902-8b1946646d4f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.035709 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c59afe0-be0e-435e-b902-8b1946646d4f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.096677 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6c59afe0-be0e-435e-b902-8b1946646d4f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:00.105055 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6c59afe0-be0e-435e-b902-8b1946646d4f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:00.106580 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6c59afe0-be0e-435e-b902-8b1946646d4f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:00.108137 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6c59afe0-be0e-435e-b902-8b1946646d4f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1277 microversion: 2.20 time: 0.084727 Jun 22 10:19:00.108600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 44/90] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:00 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:00.320016 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d0d62d27-40a7-4d22-a0b1-3be81d6798a3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:00.320679 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d0d62d27-40a7-4d22-a0b1-3be81d6798a3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:00.322546 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=24 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:00.330353 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d0d62d27-40a7-4d22-a0b1-3be81d6798a3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.330353 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d0d62d27-40a7-4d22-a0b1-3be81d6798a3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.330353 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d0d62d27-40a7-4d22-a0b1-3be81d6798a3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.330353 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d0d62d27-40a7-4d22-a0b1-3be81d6798a3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.392094 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d0d62d27-40a7-4d22-a0b1-3be81d6798a3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:00.399598 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d0d62d27-40a7-4d22-a0b1-3be81d6798a3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1289 microversion: 2.1 time: 0.083357 Jun 22 10:19:00.400464 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 47/91] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:00 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:00.472393 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-85d6f310-2f40-47fe-97d1-e67b09b01ddf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:00.473047 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-85d6f310-2f40-47fe-97d1-e67b09b01ddf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:00.479229 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-85d6f310-2f40-47fe-97d1-e67b09b01ddf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.479683 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-85d6f310-2f40-47fe-97d1-e67b09b01ddf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.480460 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-85d6f310-2f40-47fe-97d1-e67b09b01ddf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.480949 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-85d6f310-2f40-47fe-97d1-e67b09b01ddf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.640012 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e2344597-cacb-475b-84d4-9a9d111f9c10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:00.640616 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e2344597-cacb-475b-84d4-9a9d111f9c10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:00.647674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e2344597-cacb-475b-84d4-9a9d111f9c10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.648123 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e2344597-cacb-475b-84d4-9a9d111f9c10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.648949 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e2344597-cacb-475b-84d4-9a9d111f9c10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.649402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e2344597-cacb-475b-84d4-9a9d111f9c10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.677944 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-85d6f310-2f40-47fe-97d1-e67b09b01ddf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:00.695865 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-85d6f310-2f40-47fe-97d1-e67b09b01ddf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.227037 Jun 22 10:19:00.696455 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 45/92] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:00 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:00.788644 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e2344597-cacb-475b-84d4-9a9d111f9c10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:00.796480 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e2344597-cacb-475b-84d4-9a9d111f9c10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.160419 Jun 22 10:19:00.797083 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 48/93] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:00 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:01.125167 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bb9133d9-563f-4043-bd9c-9e922663278f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:01.125769 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bb9133d9-563f-4043-bd9c-9e922663278f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:01.132794 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bb9133d9-563f-4043-bd9c-9e922663278f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:01.133296 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bb9133d9-563f-4043-bd9c-9e922663278f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:01.134089 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bb9133d9-563f-4043-bd9c-9e922663278f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:01.134523 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bb9133d9-563f-4043-bd9c-9e922663278f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:01.202131 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bb9133d9-563f-4043-bd9c-9e922663278f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:01.211975 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bb9133d9-563f-4043-bd9c-9e922663278f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:01.211975 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bb9133d9-563f-4043-bd9c-9e922663278f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:01.215150 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bb9133d9-563f-4043-bd9c-9e922663278f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1277 microversion: 2.20 time: 0.091866 Jun 22 10:19:01.215150 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 46/94] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:01 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:01.416735 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5e59fe31-dd3f-425f-91ea-f158e7edc9be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:01.417414 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5e59fe31-dd3f-425f-91ea-f158e7edc9be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:01.424096 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5e59fe31-dd3f-425f-91ea-f158e7edc9be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:01.424621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5e59fe31-dd3f-425f-91ea-f158e7edc9be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:01.425341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5e59fe31-dd3f-425f-91ea-f158e7edc9be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:01.425788 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5e59fe31-dd3f-425f-91ea-f158e7edc9be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:01.487451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5e59fe31-dd3f-425f-91ea-f158e7edc9be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:01.495025 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5e59fe31-dd3f-425f-91ea-f158e7edc9be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1289 microversion: 2.1 time: 0.082114 Jun 22 10:19:01.497918 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 49/95] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:01 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1289 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:01.712555 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-16228217-2e95-4db1-9760-cc3f849c6881 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:01.713400 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-16228217-2e95-4db1-9760-cc3f849c6881 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:01.719575 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-16228217-2e95-4db1-9760-cc3f849c6881 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:01.720729 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-16228217-2e95-4db1-9760-cc3f849c6881 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:01.721533 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-16228217-2e95-4db1-9760-cc3f849c6881 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:01.722205 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-16228217-2e95-4db1-9760-cc3f849c6881 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:01.814185 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5e488aad-cd30-4d64-88f4-322122345225 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:01.814899 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5e488aad-cd30-4d64-88f4-322122345225 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:01.821318 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5e488aad-cd30-4d64-88f4-322122345225 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:01.830648 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5e488aad-cd30-4d64-88f4-322122345225 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:01.830648 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5e488aad-cd30-4d64-88f4-322122345225 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:01.830648 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5e488aad-cd30-4d64-88f4-322122345225 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:01.865211 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-16228217-2e95-4db1-9760-cc3f849c6881 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:01.867433 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-16228217-2e95-4db1-9760-cc3f849c6881 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.158601 Jun 22 10:19:01.868185 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 47/96] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:01 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:01.974468 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5e488aad-cd30-4d64-88f4-322122345225 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:01.987193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5e488aad-cd30-4d64-88f4-322122345225 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.172113 Jun 22 10:19:01.987193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 50/97] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:01 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:02.232626 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3774fd68-1ef0-47d6-9069-25e978d2a900 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:02.233326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3774fd68-1ef0-47d6-9069-25e978d2a900 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:02.236691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=4 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:02.237375 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=8 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:02.241501 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3774fd68-1ef0-47d6-9069-25e978d2a900 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:02.241501 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3774fd68-1ef0-47d6-9069-25e978d2a900 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:02.242203 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3774fd68-1ef0-47d6-9069-25e978d2a900 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:02.242633 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3774fd68-1ef0-47d6-9069-25e978d2a900 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:02.307477 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3774fd68-1ef0-47d6-9069-25e978d2a900 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:02.315856 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3774fd68-1ef0-47d6-9069-25e978d2a900 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:02.317415 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3774fd68-1ef0-47d6-9069-25e978d2a900 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:02.318522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3774fd68-1ef0-47d6-9069-25e978d2a900 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1277 microversion: 2.20 time: 0.091483 Jun 22 10:19:02.319087 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 48/98] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:02 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:02.511433 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2382e2da-0c59-4602-a619-9185d1d7b54b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:02.512061 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2382e2da-0c59-4602-a619-9185d1d7b54b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:02.518388 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2382e2da-0c59-4602-a619-9185d1d7b54b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:02.518836 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2382e2da-0c59-4602-a619-9185d1d7b54b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:02.519594 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2382e2da-0c59-4602-a619-9185d1d7b54b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:02.520030 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2382e2da-0c59-4602-a619-9185d1d7b54b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:02.586580 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2382e2da-0c59-4602-a619-9185d1d7b54b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:02.597522 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2382e2da-0c59-4602-a619-9185d1d7b54b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1289 microversion: 2.1 time: 0.087576 Jun 22 10:19:02.597522 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 51/99] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:02 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:02.883811 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-985df004-7862-4f7d-b712-dfdf267d16d3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:02.884425 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-985df004-7862-4f7d-b712-dfdf267d16d3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:02.891159 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-985df004-7862-4f7d-b712-dfdf267d16d3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:02.892166 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-985df004-7862-4f7d-b712-dfdf267d16d3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:02.893147 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-985df004-7862-4f7d-b712-dfdf267d16d3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:02.893767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-985df004-7862-4f7d-b712-dfdf267d16d3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:03.000653 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d393f261-e531-4cfe-b246-0606fe798461 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:03.001738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d393f261-e531-4cfe-b246-0606fe798461 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:03.009351 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d393f261-e531-4cfe-b246-0606fe798461 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:03.009773 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d393f261-e531-4cfe-b246-0606fe798461 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:03.014118 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d393f261-e531-4cfe-b246-0606fe798461 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:03.014118 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d393f261-e531-4cfe-b246-0606fe798461 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:03.037015 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-985df004-7862-4f7d-b712-dfdf267d16d3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:03.046756 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-985df004-7862-4f7d-b712-dfdf267d16d3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.167049 Jun 22 10:19:03.048580 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 49/100] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:02 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:03.335982 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fe04e343-df28-4669-a123-c2f72ac91714 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:03.336653 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-fe04e343-df28-4669-a123-c2f72ac91714 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:03.342997 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fe04e343-df28-4669-a123-c2f72ac91714 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:03.348275 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fe04e343-df28-4669-a123-c2f72ac91714 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:03.348275 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fe04e343-df28-4669-a123-c2f72ac91714 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:03.348275 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fe04e343-df28-4669-a123-c2f72ac91714 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:03.480267 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-fe04e343-df28-4669-a123-c2f72ac91714 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:03.487734 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-fe04e343-df28-4669-a123-c2f72ac91714 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:03.489613 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-fe04e343-df28-4669-a123-c2f72ac91714 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:03.491173 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-fe04e343-df28-4669-a123-c2f72ac91714 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.158878 Jun 22 10:19:03.492006 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 50/101] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:03 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:03.614892 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ec9f8675-e472-426a-b398-54d069efbe1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:03.615507 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ec9f8675-e472-426a-b398-54d069efbe1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:03.632201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ec9f8675-e472-426a-b398-54d069efbe1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:03.633344 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ec9f8675-e472-426a-b398-54d069efbe1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:03.634315 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ec9f8675-e472-426a-b398-54d069efbe1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:03.634902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ec9f8675-e472-426a-b398-54d069efbe1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:03.859829 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ec9f8675-e472-426a-b398-54d069efbe1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:03.869230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ec9f8675-e472-426a-b398-54d069efbe1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1297 microversion: 2.1 time: 0.261294 Jun 22 10:19:03.869922 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 51/102] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:03 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1297 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:03.879187 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d393f261-e531-4cfe-b246-0606fe798461 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:03.887248 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d393f261-e531-4cfe-b246-0606fe798461 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.891547 Jun 22 10:19:03.896723 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 52/103] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:02 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:04.064043 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9b201622-bc8c-46d5-b999-115adc8def8a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:04.065035 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9b201622-bc8c-46d5-b999-115adc8def8a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:04.070962 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9b201622-bc8c-46d5-b999-115adc8def8a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:04.071409 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9b201622-bc8c-46d5-b999-115adc8def8a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:04.072496 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9b201622-bc8c-46d5-b999-115adc8def8a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:04.073269 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9b201622-bc8c-46d5-b999-115adc8def8a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:04.211345 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9b201622-bc8c-46d5-b999-115adc8def8a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:04.218866 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9b201622-bc8c-46d5-b999-115adc8def8a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.159277 Jun 22 10:19:04.219443 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 52/104] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:04 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:04.510534 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-362463d1-6408-4a39-adff-898a4c891c03 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:04.511050 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-362463d1-6408-4a39-adff-898a4c891c03 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:04.513037 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=4 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:04.518149 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-362463d1-6408-4a39-adff-898a4c891c03 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:04.518598 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-362463d1-6408-4a39-adff-898a4c891c03 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:04.519351 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-362463d1-6408-4a39-adff-898a4c891c03 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:04.519779 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-362463d1-6408-4a39-adff-898a4c891c03 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:04.593432 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-362463d1-6408-4a39-adff-898a4c891c03 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:04.603173 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-362463d1-6408-4a39-adff-898a4c891c03 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:04.604964 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-362463d1-6408-4a39-adff-898a4c891c03 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:04.606115 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-362463d1-6408-4a39-adff-898a4c891c03 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.099603 Jun 22 10:19:04.615571 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 53/105] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:04 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:04.886547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-04ffb2c2-51fe-42a5-911b-baa7a408c6e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:04.887218 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-04ffb2c2-51fe-42a5-911b-baa7a408c6e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:04.894264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-04ffb2c2-51fe-42a5-911b-baa7a408c6e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:04.894708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-04ffb2c2-51fe-42a5-911b-baa7a408c6e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:04.895512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-04ffb2c2-51fe-42a5-911b-baa7a408c6e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:04.896054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-04ffb2c2-51fe-42a5-911b-baa7a408c6e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:04.903332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2c33e89a-538e-45f7-af72-99ce616f126d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:04.903941 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2c33e89a-538e-45f7-af72-99ce616f126d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:04.911156 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c33e89a-538e-45f7-af72-99ce616f126d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:04.911612 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c33e89a-538e-45f7-af72-99ce616f126d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:04.912381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c33e89a-538e-45f7-af72-99ce616f126d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:04.913109 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c33e89a-538e-45f7-af72-99ce616f126d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:04.972570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-04ffb2c2-51fe-42a5-911b-baa7a408c6e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:04.980519 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-04ffb2c2-51fe-42a5-911b-baa7a408c6e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.097704 Jun 22 10:19:04.981562 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 53/106] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:04 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:05.068482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2c33e89a-538e-45f7-af72-99ce616f126d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:05.077528 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2c33e89a-538e-45f7-af72-99ce616f126d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.177935 Jun 22 10:19:05.078330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 54/107] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:04 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:05.235809 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-24250172-4700-4a01-abd0-2399fcc309a3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:05.236417 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-24250172-4700-4a01-abd0-2399fcc309a3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:05.242425 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-24250172-4700-4a01-abd0-2399fcc309a3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:05.242877 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-24250172-4700-4a01-abd0-2399fcc309a3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:05.243636 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-24250172-4700-4a01-abd0-2399fcc309a3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:05.244124 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-24250172-4700-4a01-abd0-2399fcc309a3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:05.377942 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-24250172-4700-4a01-abd0-2399fcc309a3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:05.385526 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-24250172-4700-4a01-abd0-2399fcc309a3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.153664 Jun 22 10:19:05.386089 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 54/108] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:05 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:05.624659 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7fec34c6-0baf-4743-946a-ad930b898730 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:05.625454 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7fec34c6-0baf-4743-946a-ad930b898730 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:05.632047 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7fec34c6-0baf-4743-946a-ad930b898730 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:05.632653 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7fec34c6-0baf-4743-946a-ad930b898730 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:05.633637 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7fec34c6-0baf-4743-946a-ad930b898730 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:05.634079 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7fec34c6-0baf-4743-946a-ad930b898730 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:05.695786 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7fec34c6-0baf-4743-946a-ad930b898730 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:05.703665 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7fec34c6-0baf-4743-946a-ad930b898730 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:05.705218 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7fec34c6-0baf-4743-946a-ad930b898730 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:05.706319 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7fec34c6-0baf-4743-946a-ad930b898730 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.085684 Jun 22 10:19:05.706876 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 55/109] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:05 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:05.997505 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9e4911e2-078b-45e4-9ead-a7bfdc028652 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:05.998111 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9e4911e2-078b-45e4-9ead-a7bfdc028652 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:06.004364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9e4911e2-078b-45e4-9ead-a7bfdc028652 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.004833 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9e4911e2-078b-45e4-9ead-a7bfdc028652 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.005613 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9e4911e2-078b-45e4-9ead-a7bfdc028652 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.006118 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9e4911e2-078b-45e4-9ead-a7bfdc028652 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.070885 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9e4911e2-078b-45e4-9ead-a7bfdc028652 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:06.078265 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9e4911e2-078b-45e4-9ead-a7bfdc028652 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.084592 Jun 22 10:19:06.078833 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 55/110] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:05 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:06.094813 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1b7f6f4b-20ef-4e9a-b0c4-3afeb5df88b1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:06.095421 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1b7f6f4b-20ef-4e9a-b0c4-3afeb5df88b1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:06.101536 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1b7f6f4b-20ef-4e9a-b0c4-3afeb5df88b1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.101986 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1b7f6f4b-20ef-4e9a-b0c4-3afeb5df88b1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.102777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1b7f6f4b-20ef-4e9a-b0c4-3afeb5df88b1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.103242 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1b7f6f4b-20ef-4e9a-b0c4-3afeb5df88b1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.235125 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1b7f6f4b-20ef-4e9a-b0c4-3afeb5df88b1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:06.242780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1b7f6f4b-20ef-4e9a-b0c4-3afeb5df88b1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.152181 Jun 22 10:19:06.243359 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 56/111] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:06 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:06.402716 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-408bd476-6a21-4ed3-9563-9a195892a8f6 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:06.403323 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-408bd476-6a21-4ed3-9563-9a195892a8f6 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:06.410014 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-408bd476-6a21-4ed3-9563-9a195892a8f6 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.410489 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-408bd476-6a21-4ed3-9563-9a195892a8f6 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.411242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-408bd476-6a21-4ed3-9563-9a195892a8f6 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.411672 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-408bd476-6a21-4ed3-9563-9a195892a8f6 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.430552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:06.543258 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-408bd476-6a21-4ed3-9563-9a195892a8f6 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:06.552309 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-408bd476-6a21-4ed3-9563-9a195892a8f6 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.153406 Jun 22 10:19:06.553412 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 56/112] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:06 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:06.724167 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-50fbff34-d65e-4539-b687-065228e181dc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:06.724849 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-50fbff34-d65e-4539-b687-065228e181dc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:06.731066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-50fbff34-d65e-4539-b687-065228e181dc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.731704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-50fbff34-d65e-4539-b687-065228e181dc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.732498 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-50fbff34-d65e-4539-b687-065228e181dc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.732946 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-50fbff34-d65e-4539-b687-065228e181dc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.794434 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-50fbff34-d65e-4539-b687-065228e181dc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:06.802765 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-50fbff34-d65e-4539-b687-065228e181dc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:06.804381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-50fbff34-d65e-4539-b687-065228e181dc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:06.805576 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-50fbff34-d65e-4539-b687-065228e181dc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.085925 Jun 22 10:19:06.806129 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 57/113] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:06 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:07.097501 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d2707eb7-af02-45f1-9c0b-3534e7cc7282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:07.098106 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d2707eb7-af02-45f1-9c0b-3534e7cc7282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:07.105065 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d2707eb7-af02-45f1-9c0b-3534e7cc7282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:07.105636 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d2707eb7-af02-45f1-9c0b-3534e7cc7282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:07.106417 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d2707eb7-af02-45f1-9c0b-3534e7cc7282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:07.106858 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d2707eb7-af02-45f1-9c0b-3534e7cc7282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:07.172693 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d2707eb7-af02-45f1-9c0b-3534e7cc7282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:07.180905 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d2707eb7-af02-45f1-9c0b-3534e7cc7282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.087224 Jun 22 10:19:07.181387 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 57/114] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:07 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:07.258906 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c35a6667-79e6-438d-9fd7-ba782c040df1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:07.259524 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c35a6667-79e6-438d-9fd7-ba782c040df1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:07.267125 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c35a6667-79e6-438d-9fd7-ba782c040df1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:07.267315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c35a6667-79e6-438d-9fd7-ba782c040df1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:07.268023 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c35a6667-79e6-438d-9fd7-ba782c040df1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:07.268491 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c35a6667-79e6-438d-9fd7-ba782c040df1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:07.402232 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c35a6667-79e6-438d-9fd7-ba782c040df1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:07.410194 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c35a6667-79e6-438d-9fd7-ba782c040df1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.155105 Jun 22 10:19:07.410769 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 58/115] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:07 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:07.569829 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0c7577f0-7bd1-48fa-923a-5bfca40b1577 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:07.570700 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0c7577f0-7bd1-48fa-923a-5bfca40b1577 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:07.576777 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0c7577f0-7bd1-48fa-923a-5bfca40b1577 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:07.577247 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0c7577f0-7bd1-48fa-923a-5bfca40b1577 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:07.578011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0c7577f0-7bd1-48fa-923a-5bfca40b1577 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:07.578441 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0c7577f0-7bd1-48fa-923a-5bfca40b1577 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:07.725329 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0c7577f0-7bd1-48fa-923a-5bfca40b1577 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:07.732967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0c7577f0-7bd1-48fa-923a-5bfca40b1577 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.167030 Jun 22 10:19:07.733543 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 58/116] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:07 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:07.823511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5f0fd8fd-b013-4f2d-ae85-df76077f46d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:07.824657 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5f0fd8fd-b013-4f2d-ae85-df76077f46d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:07.831189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5f0fd8fd-b013-4f2d-ae85-df76077f46d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:07.831639 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5f0fd8fd-b013-4f2d-ae85-df76077f46d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:07.832470 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5f0fd8fd-b013-4f2d-ae85-df76077f46d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:07.833134 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5f0fd8fd-b013-4f2d-ae85-df76077f46d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:07.901862 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5f0fd8fd-b013-4f2d-ae85-df76077f46d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:07.905256 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:07.910821 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5f0fd8fd-b013-4f2d-ae85-df76077f46d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:07.912295 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5f0fd8fd-b013-4f2d-ae85-df76077f46d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:07.913426 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5f0fd8fd-b013-4f2d-ae85-df76077f46d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.093979 Jun 22 10:19:07.913976 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 59/117] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:07 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:08.197864 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e6252cdf-ef27-4b74-882d-cfe2b62ba7b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:08.198543 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e6252cdf-ef27-4b74-882d-cfe2b62ba7b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:08.204986 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e6252cdf-ef27-4b74-882d-cfe2b62ba7b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:08.205442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e6252cdf-ef27-4b74-882d-cfe2b62ba7b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:08.206204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e6252cdf-ef27-4b74-882d-cfe2b62ba7b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:08.206643 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e6252cdf-ef27-4b74-882d-cfe2b62ba7b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:08.267237 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-e6252cdf-ef27-4b74-882d-cfe2b62ba7b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:08.275061 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e6252cdf-ef27-4b74-882d-cfe2b62ba7b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.081168 Jun 22 10:19:08.275621 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 59/118] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:08 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:08.433115 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ceecce53-1572-4ed4-8584-1b6157c05bf8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:08.433718 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ceecce53-1572-4ed4-8584-1b6157c05bf8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:08.440630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ceecce53-1572-4ed4-8584-1b6157c05bf8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:08.441104 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ceecce53-1572-4ed4-8584-1b6157c05bf8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:08.441855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ceecce53-1572-4ed4-8584-1b6157c05bf8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:08.442285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ceecce53-1572-4ed4-8584-1b6157c05bf8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:08.578446 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ceecce53-1572-4ed4-8584-1b6157c05bf8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:08.586364 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ceecce53-1572-4ed4-8584-1b6157c05bf8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.156941 Jun 22 10:19:08.587044 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 60/119] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:08 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:08.753750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5eb78e9f-ab60-4311-a2bb-7f531c3a26df tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:08.753750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5eb78e9f-ab60-4311-a2bb-7f531c3a26df tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:08.758492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5eb78e9f-ab60-4311-a2bb-7f531c3a26df tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:08.759196 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5eb78e9f-ab60-4311-a2bb-7f531c3a26df tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:08.760215 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5eb78e9f-ab60-4311-a2bb-7f531c3a26df tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:08.760661 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5eb78e9f-ab60-4311-a2bb-7f531c3a26df tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:08.922806 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5eb78e9f-ab60-4311-a2bb-7f531c3a26df tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:08.930698 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5eb78e9f-ab60-4311-a2bb-7f531c3a26df tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.184281 Jun 22 10:19:08.931281 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 60/120] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:08 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:08.932201 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-eeb9119b-a000-4bcf-86ec-6dd852b3409e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:08.932944 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-eeb9119b-a000-4bcf-86ec-6dd852b3409e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:08.939958 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-eeb9119b-a000-4bcf-86ec-6dd852b3409e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:08.940517 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-eeb9119b-a000-4bcf-86ec-6dd852b3409e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:08.941613 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-eeb9119b-a000-4bcf-86ec-6dd852b3409e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:08.942057 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-eeb9119b-a000-4bcf-86ec-6dd852b3409e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:09.002880 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-eeb9119b-a000-4bcf-86ec-6dd852b3409e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:09.010652 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-eeb9119b-a000-4bcf-86ec-6dd852b3409e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:09.012159 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-eeb9119b-a000-4bcf-86ec-6dd852b3409e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:09.013362 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-eeb9119b-a000-4bcf-86ec-6dd852b3409e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.085764 Jun 22 10:19:09.013914 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 61/121] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:08 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:09.292529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f19db033-011c-47b7-9a7c-ee06692911fc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:09.293190 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f19db033-011c-47b7-9a7c-ee06692911fc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:09.299926 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f19db033-011c-47b7-9a7c-ee06692911fc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:09.300404 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f19db033-011c-47b7-9a7c-ee06692911fc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:09.301534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f19db033-011c-47b7-9a7c-ee06692911fc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:09.301983 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f19db033-011c-47b7-9a7c-ee06692911fc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:09.369155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f19db033-011c-47b7-9a7c-ee06692911fc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:09.377193 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f19db033-011c-47b7-9a7c-ee06692911fc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.088525 Jun 22 10:19:09.377757 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 61/122] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:09 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:09.603361 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-058a3bc5-0945-4a5d-a4a7-5074e6eead57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:09.606439 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-058a3bc5-0945-4a5d-a4a7-5074e6eead57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:09.610542 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-058a3bc5-0945-4a5d-a4a7-5074e6eead57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:09.610992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-058a3bc5-0945-4a5d-a4a7-5074e6eead57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:09.611760 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-058a3bc5-0945-4a5d-a4a7-5074e6eead57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:09.612199 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-058a3bc5-0945-4a5d-a4a7-5074e6eead57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:09.747997 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-058a3bc5-0945-4a5d-a4a7-5074e6eead57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:09.756714 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-058a3bc5-0945-4a5d-a4a7-5074e6eead57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.157085 Jun 22 10:19:09.757333 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 62/123] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:09 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:09.949274 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-260d51fc-db28-4ad9-983e-b6358dec27ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:09.949796 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-260d51fc-db28-4ad9-983e-b6358dec27ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:09.956304 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-260d51fc-db28-4ad9-983e-b6358dec27ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:09.956753 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-260d51fc-db28-4ad9-983e-b6358dec27ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:09.957545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-260d51fc-db28-4ad9-983e-b6358dec27ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:09.957987 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-260d51fc-db28-4ad9-983e-b6358dec27ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:10.031552 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-51a6178e-4b55-4ca1-9540-556415c57066 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:10.032727 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-51a6178e-4b55-4ca1-9540-556415c57066 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:10.038894 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-51a6178e-4b55-4ca1-9540-556415c57066 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:10.039364 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-51a6178e-4b55-4ca1-9540-556415c57066 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:10.040118 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-51a6178e-4b55-4ca1-9540-556415c57066 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:10.040555 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-51a6178e-4b55-4ca1-9540-556415c57066 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:10.095618 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-260d51fc-db28-4ad9-983e-b6358dec27ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:10.103180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-260d51fc-db28-4ad9-983e-b6358dec27ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.157763 Jun 22 10:19:10.103753 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 62/124] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:09 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:10.115358 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-51a6178e-4b55-4ca1-9540-556415c57066 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:10.123215 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-51a6178e-4b55-4ca1-9540-556415c57066 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:10.124696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-51a6178e-4b55-4ca1-9540-556415c57066 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:10.125811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-51a6178e-4b55-4ca1-9540-556415c57066 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.098335 Jun 22 10:19:10.126353 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 63/125] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:10 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:10.394494 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9bb7ad83-54db-469e-8dc6-083e14ce71b2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:10.395097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9bb7ad83-54db-469e-8dc6-083e14ce71b2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:10.401043 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9bb7ad83-54db-469e-8dc6-083e14ce71b2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:10.401486 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9bb7ad83-54db-469e-8dc6-083e14ce71b2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:10.402233 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9bb7ad83-54db-469e-8dc6-083e14ce71b2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:10.402663 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9bb7ad83-54db-469e-8dc6-083e14ce71b2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:10.462007 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9bb7ad83-54db-469e-8dc6-083e14ce71b2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:10.469274 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9bb7ad83-54db-469e-8dc6-083e14ce71b2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.079384 Jun 22 10:19:10.469832 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 63/126] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:10 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:10.774197 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2aa79bf0-4ab7-403b-8937-ec543eb5c83e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:10.775315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2aa79bf0-4ab7-403b-8937-ec543eb5c83e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:10.782072 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2aa79bf0-4ab7-403b-8937-ec543eb5c83e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:10.782252 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2aa79bf0-4ab7-403b-8937-ec543eb5c83e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:10.783022 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2aa79bf0-4ab7-403b-8937-ec543eb5c83e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:10.783450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2aa79bf0-4ab7-403b-8937-ec543eb5c83e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:10.908960 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2aa79bf0-4ab7-403b-8937-ec543eb5c83e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:10.916419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2aa79bf0-4ab7-403b-8937-ec543eb5c83e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.145875 Jun 22 10:19:10.916936 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 64/127] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:10 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:11.120187 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ebb68f7f-9c09-43e4-8e4f-56c64c521cbc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:11.120839 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ebb68f7f-9c09-43e4-8e4f-56c64c521cbc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:11.126988 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ebb68f7f-9c09-43e4-8e4f-56c64c521cbc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.127436 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ebb68f7f-9c09-43e4-8e4f-56c64c521cbc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:11.128186 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ebb68f7f-9c09-43e4-8e4f-56c64c521cbc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.128619 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ebb68f7f-9c09-43e4-8e4f-56c64c521cbc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:11.143946 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-26a2840b-a99f-4d1a-91f9-33d55d5f3191 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:11.144557 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-26a2840b-a99f-4d1a-91f9-33d55d5f3191 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:11.150574 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-26a2840b-a99f-4d1a-91f9-33d55d5f3191 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.151058 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-26a2840b-a99f-4d1a-91f9-33d55d5f3191 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:11.151832 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-26a2840b-a99f-4d1a-91f9-33d55d5f3191 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.152269 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-26a2840b-a99f-4d1a-91f9-33d55d5f3191 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:11.226825 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-26a2840b-a99f-4d1a-91f9-33d55d5f3191 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:11.235797 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-26a2840b-a99f-4d1a-91f9-33d55d5f3191 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:11.237333 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-26a2840b-a99f-4d1a-91f9-33d55d5f3191 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:11.238437 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-26a2840b-a99f-4d1a-91f9-33d55d5f3191 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.098848 Jun 22 10:19:11.238995 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 65/128] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:11 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:11.286764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ebb68f7f-9c09-43e4-8e4f-56c64c521cbc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:11.294203 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ebb68f7f-9c09-43e4-8e4f-56c64c521cbc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.177847 Jun 22 10:19:11.294762 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 64/129] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:11 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:11.485601 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9d70d81e-2743-4e64-8147-25caa7324da2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:11.486131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9d70d81e-2743-4e64-8147-25caa7324da2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:11.492626 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9d70d81e-2743-4e64-8147-25caa7324da2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.493109 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9d70d81e-2743-4e64-8147-25caa7324da2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:11.493869 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9d70d81e-2743-4e64-8147-25caa7324da2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.494306 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9d70d81e-2743-4e64-8147-25caa7324da2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:11.554147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9d70d81e-2743-4e64-8147-25caa7324da2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:11.561500 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9d70d81e-2743-4e64-8147-25caa7324da2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.079812 Jun 22 10:19:11.562262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 66/130] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:11 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:11.933294 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4161580a-36fd-41dc-85bc-0f37a54629f0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:11.933902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4161580a-36fd-41dc-85bc-0f37a54629f0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:11.940505 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4161580a-36fd-41dc-85bc-0f37a54629f0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.940989 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4161580a-36fd-41dc-85bc-0f37a54629f0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:11.941748 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4161580a-36fd-41dc-85bc-0f37a54629f0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.942179 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4161580a-36fd-41dc-85bc-0f37a54629f0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:12.070399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4161580a-36fd-41dc-85bc-0f37a54629f0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:12.077897 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4161580a-36fd-41dc-85bc-0f37a54629f0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.148392 Jun 22 10:19:12.079025 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 65/131] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:11 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:12.256068 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5bcc5657-da53-4e78-ae24-f4743647c019 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:12.256671 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5bcc5657-da53-4e78-ae24-f4743647c019 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:12.262717 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5bcc5657-da53-4e78-ae24-f4743647c019 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:12.263169 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5bcc5657-da53-4e78-ae24-f4743647c019 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:12.263930 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5bcc5657-da53-4e78-ae24-f4743647c019 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:12.264370 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5bcc5657-da53-4e78-ae24-f4743647c019 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:12.311029 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-11833028-6759-49b7-84ff-2b32cf48461c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:12.311742 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-11833028-6759-49b7-84ff-2b32cf48461c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:12.318451 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-11833028-6759-49b7-84ff-2b32cf48461c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:12.318977 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-11833028-6759-49b7-84ff-2b32cf48461c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:12.319820 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-11833028-6759-49b7-84ff-2b32cf48461c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:12.320333 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-11833028-6759-49b7-84ff-2b32cf48461c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:12.324313 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5bcc5657-da53-4e78-ae24-f4743647c019 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:12.332838 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5bcc5657-da53-4e78-ae24-f4743647c019 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:12.334344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5bcc5657-da53-4e78-ae24-f4743647c019 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:12.345369 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5bcc5657-da53-4e78-ae24-f4743647c019 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.083886 Jun 22 10:19:12.345369 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 67/132] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:12 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:12.450345 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-11833028-6759-49b7-84ff-2b32cf48461c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:12.457669 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-11833028-6759-49b7-84ff-2b32cf48461c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.150534 Jun 22 10:19:12.458992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 66/133] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:12 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:12.578746 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-fb609913-f501-4c0f-836a-cede169779d7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:12.579885 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-fb609913-f501-4c0f-836a-cede169779d7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:12.589410 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fb609913-f501-4c0f-836a-cede169779d7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:12.589863 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fb609913-f501-4c0f-836a-cede169779d7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:12.590641 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fb609913-f501-4c0f-836a-cede169779d7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:12.591082 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fb609913-f501-4c0f-836a-cede169779d7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:12.656770 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-fb609913-f501-4c0f-836a-cede169779d7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:12.667218 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-fb609913-f501-4c0f-836a-cede169779d7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.092072 Jun 22 10:19:12.677112 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 68/134] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:12 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:13.095338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1e3605c0-803e-479d-b2d5-c48e85b22a1f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:13.095935 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1e3605c0-803e-479d-b2d5-c48e85b22a1f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:13.101984 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1e3605c0-803e-479d-b2d5-c48e85b22a1f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:13.102425 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1e3605c0-803e-479d-b2d5-c48e85b22a1f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:13.103161 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1e3605c0-803e-479d-b2d5-c48e85b22a1f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:13.103667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1e3605c0-803e-479d-b2d5-c48e85b22a1f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:13.230851 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1e3605c0-803e-479d-b2d5-c48e85b22a1f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:13.239104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1e3605c0-803e-479d-b2d5-c48e85b22a1f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.148035 Jun 22 10:19:13.239670 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 67/135] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:13 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:13.353470 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-face815a-7427-462f-96c0-adf3fe492188 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:13.354052 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-face815a-7427-462f-96c0-adf3fe492188 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:13.360161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-face815a-7427-462f-96c0-adf3fe492188 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:13.364466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-face815a-7427-462f-96c0-adf3fe492188 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:13.364466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-face815a-7427-462f-96c0-adf3fe492188 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:13.364466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-face815a-7427-462f-96c0-adf3fe492188 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:13.424091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-face815a-7427-462f-96c0-adf3fe492188 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:13.432255 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-face815a-7427-462f-96c0-adf3fe492188 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:13.433791 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-face815a-7427-462f-96c0-adf3fe492188 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:13.434896 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-face815a-7427-462f-96c0-adf3fe492188 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.085478 Jun 22 10:19:13.435452 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 69/136] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:13 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:13.475140 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5dbc9937-c656-43ff-9646-83f6af0825fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:13.475744 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5dbc9937-c656-43ff-9646-83f6af0825fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:13.481853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5dbc9937-c656-43ff-9646-83f6af0825fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:13.482305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5dbc9937-c656-43ff-9646-83f6af0825fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:13.483062 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5dbc9937-c656-43ff-9646-83f6af0825fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:13.483497 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5dbc9937-c656-43ff-9646-83f6af0825fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:13.612699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5dbc9937-c656-43ff-9646-83f6af0825fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:13.620092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5dbc9937-c656-43ff-9646-83f6af0825fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.148896 Jun 22 10:19:13.620837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 68/137] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:13 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:13.684652 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9ff0655f-c777-48a8-a07a-3dfdd0c43eb0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:13.685285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9ff0655f-c777-48a8-a07a-3dfdd0c43eb0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:13.691412 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9ff0655f-c777-48a8-a07a-3dfdd0c43eb0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:13.691855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9ff0655f-c777-48a8-a07a-3dfdd0c43eb0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:13.692626 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9ff0655f-c777-48a8-a07a-3dfdd0c43eb0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:13.693081 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9ff0655f-c777-48a8-a07a-3dfdd0c43eb0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:13.762518 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9ff0655f-c777-48a8-a07a-3dfdd0c43eb0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:13.771192 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9ff0655f-c777-48a8-a07a-3dfdd0c43eb0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.090347 Jun 22 10:19:13.771760 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 70/138] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:13 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:14.256353 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6711239e-61ae-4b2b-b270-3c09e14150ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:14.256907 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6711239e-61ae-4b2b-b270-3c09e14150ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:14.262942 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6711239e-61ae-4b2b-b270-3c09e14150ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:14.263392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6711239e-61ae-4b2b-b270-3c09e14150ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:14.264149 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6711239e-61ae-4b2b-b270-3c09e14150ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:14.264587 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6711239e-61ae-4b2b-b270-3c09e14150ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:14.393486 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6711239e-61ae-4b2b-b270-3c09e14150ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:14.401057 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6711239e-61ae-4b2b-b270-3c09e14150ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.148657 Jun 22 10:19:14.401626 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 69/139] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:14 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:14.454362 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-96156314-fdf9-4beb-ac87-2eb8c63ed74f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:14.454959 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-96156314-fdf9-4beb-ac87-2eb8c63ed74f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:14.461001 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-96156314-fdf9-4beb-ac87-2eb8c63ed74f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:14.461439 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-96156314-fdf9-4beb-ac87-2eb8c63ed74f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:14.462196 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-96156314-fdf9-4beb-ac87-2eb8c63ed74f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:14.462611 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-96156314-fdf9-4beb-ac87-2eb8c63ed74f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:14.526349 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-96156314-fdf9-4beb-ac87-2eb8c63ed74f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:14.535143 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-96156314-fdf9-4beb-ac87-2eb8c63ed74f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:14.536653 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-96156314-fdf9-4beb-ac87-2eb8c63ed74f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:14.537791 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-96156314-fdf9-4beb-ac87-2eb8c63ed74f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.087338 Jun 22 10:19:14.538343 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 71/140] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:14 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:14.636832 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-75ecce8e-a934-4815-92ba-2d41ad1e4bb0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:14.637449 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-75ecce8e-a934-4815-92ba-2d41ad1e4bb0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:14.643691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-75ecce8e-a934-4815-92ba-2d41ad1e4bb0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:14.644132 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-75ecce8e-a934-4815-92ba-2d41ad1e4bb0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:14.644902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-75ecce8e-a934-4815-92ba-2d41ad1e4bb0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:14.645330 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-75ecce8e-a934-4815-92ba-2d41ad1e4bb0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:14.772745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-75ecce8e-a934-4815-92ba-2d41ad1e4bb0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:14.780230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-75ecce8e-a934-4815-92ba-2d41ad1e4bb0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.147178 Jun 22 10:19:14.780766 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 70/141] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:14 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:14.787884 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-25cb5145-7596-4c75-b546-946c3bea225e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:14.788498 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-25cb5145-7596-4c75-b546-946c3bea225e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:14.794488 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-25cb5145-7596-4c75-b546-946c3bea225e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:14.794933 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-25cb5145-7596-4c75-b546-946c3bea225e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:14.795699 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-25cb5145-7596-4c75-b546-946c3bea225e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:14.796141 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-25cb5145-7596-4c75-b546-946c3bea225e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:14.856374 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-25cb5145-7596-4c75-b546-946c3bea225e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:14.864662 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-25cb5145-7596-4c75-b546-946c3bea225e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.080502 Jun 22 10:19:14.865269 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 72/142] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:14 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:15.418039 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9920cde1-7d93-4cd5-98ad-c26264ab6cab tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:15.418703 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9920cde1-7d93-4cd5-98ad-c26264ab6cab tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:15.424902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9920cde1-7d93-4cd5-98ad-c26264ab6cab tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:15.425355 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9920cde1-7d93-4cd5-98ad-c26264ab6cab tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:15.426119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9920cde1-7d93-4cd5-98ad-c26264ab6cab tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:15.426553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9920cde1-7d93-4cd5-98ad-c26264ab6cab tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:15.555975 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a7c2e9db-9fb5-48f3-a226-bf659c6468ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:15.556578 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a7c2e9db-9fb5-48f3-a226-bf659c6468ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:15.561152 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9920cde1-7d93-4cd5-98ad-c26264ab6cab tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:15.562922 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a7c2e9db-9fb5-48f3-a226-bf659c6468ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:15.563377 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a7c2e9db-9fb5-48f3-a226-bf659c6468ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:15.564707 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a7c2e9db-9fb5-48f3-a226-bf659c6468ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:15.565203 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a7c2e9db-9fb5-48f3-a226-bf659c6468ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:15.569165 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9920cde1-7d93-4cd5-98ad-c26264ab6cab tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.155103 Jun 22 10:19:15.569742 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 71/143] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:15 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:15.626355 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a7c2e9db-9fb5-48f3-a226-bf659c6468ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:15.636220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a7c2e9db-9fb5-48f3-a226-bf659c6468ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:15.637886 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a7c2e9db-9fb5-48f3-a226-bf659c6468ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:15.638993 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a7c2e9db-9fb5-48f3-a226-bf659c6468ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.087003 Jun 22 10:19:15.639555 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 73/144] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:15 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:15.797472 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a631e404-c540-46ca-8fd8-21e707c1d451 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:15.798076 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a631e404-c540-46ca-8fd8-21e707c1d451 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:15.804554 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a631e404-c540-46ca-8fd8-21e707c1d451 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:15.805024 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a631e404-c540-46ca-8fd8-21e707c1d451 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:15.805769 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a631e404-c540-46ca-8fd8-21e707c1d451 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:15.806193 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a631e404-c540-46ca-8fd8-21e707c1d451 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:15.882093 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ffd2872f-b3e0-4000-8f23-4728b5147e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:15.882614 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ffd2872f-b3e0-4000-8f23-4728b5147e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:15.888682 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ffd2872f-b3e0-4000-8f23-4728b5147e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:15.889182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ffd2872f-b3e0-4000-8f23-4728b5147e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:15.889950 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ffd2872f-b3e0-4000-8f23-4728b5147e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:15.890643 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ffd2872f-b3e0-4000-8f23-4728b5147e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:15.969634 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ffd2872f-b3e0-4000-8f23-4728b5147e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:15.975939 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a631e404-c540-46ca-8fd8-21e707c1d451 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:15.977776 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ffd2872f-b3e0-4000-8f23-4728b5147e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.100202 Jun 22 10:19:15.978368 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 74/145] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:15 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:15.981061 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a631e404-c540-46ca-8fd8-21e707c1d451 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.187312 Jun 22 10:19:15.981631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 72/146] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:15 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:16.586478 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9b360177-6eaf-4350-b0af-ba57fc4c360f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:16.587077 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9b360177-6eaf-4350-b0af-ba57fc4c360f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:16.593022 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b360177-6eaf-4350-b0af-ba57fc4c360f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:16.593462 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b360177-6eaf-4350-b0af-ba57fc4c360f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:16.594204 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b360177-6eaf-4350-b0af-ba57fc4c360f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:16.594627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b360177-6eaf-4350-b0af-ba57fc4c360f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:16.657006 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b1beca3f-b7c1-4d0d-9854-67dd56dd31e6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:16.657613 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b1beca3f-b7c1-4d0d-9854-67dd56dd31e6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:16.665698 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b1beca3f-b7c1-4d0d-9854-67dd56dd31e6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:16.666294 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b1beca3f-b7c1-4d0d-9854-67dd56dd31e6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:16.667210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b1beca3f-b7c1-4d0d-9854-67dd56dd31e6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:16.667865 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b1beca3f-b7c1-4d0d-9854-67dd56dd31e6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:16.672300 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:16.742189 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b1beca3f-b7c1-4d0d-9854-67dd56dd31e6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:16.746704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9b360177-6eaf-4350-b0af-ba57fc4c360f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:16.752204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b1beca3f-b7c1-4d0d-9854-67dd56dd31e6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:16.753755 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b1beca3f-b7c1-4d0d-9854-67dd56dd31e6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:16.755374 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b1beca3f-b7c1-4d0d-9854-67dd56dd31e6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.101742 Jun 22 10:19:16.755494 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9b360177-6eaf-4350-b0af-ba57fc4c360f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.172578 Jun 22 10:19:16.755588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 73/147] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:16 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:16.756084 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 75/148] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:16 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:16.995819 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b7332374-1366-4b59-a01c-f6bddee05493 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:16.996529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b7332374-1366-4b59-a01c-f6bddee05493 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:16.997885 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b81b2552-f18d-42bc-922b-28c43707dab5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:16.998487 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b81b2552-f18d-42bc-922b-28c43707dab5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:17.003296 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b7332374-1366-4b59-a01c-f6bddee05493 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:17.003745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b7332374-1366-4b59-a01c-f6bddee05493 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:17.004507 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b7332374-1366-4b59-a01c-f6bddee05493 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:17.004972 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b7332374-1366-4b59-a01c-f6bddee05493 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:17.005079 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b81b2552-f18d-42bc-922b-28c43707dab5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:17.005484 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b81b2552-f18d-42bc-922b-28c43707dab5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:17.006230 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b81b2552-f18d-42bc-922b-28c43707dab5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:17.006657 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b81b2552-f18d-42bc-922b-28c43707dab5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:17.024994 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:17.095024 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b7332374-1366-4b59-a01c-f6bddee05493 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:17.116185 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b7332374-1366-4b59-a01c-f6bddee05493 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.123739 Jun 22 10:19:17.117192 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 74/149] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:16 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:17.170326 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b81b2552-f18d-42bc-922b-28c43707dab5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:17.178160 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b81b2552-f18d-42bc-922b-28c43707dab5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.184011 Jun 22 10:19:17.178719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 76/150] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:16 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:17.771712 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c6cf79c8-066e-4a27-ab81-30475e58250f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:17.772308 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c6cf79c8-066e-4a27-ab81-30475e58250f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:17.773014 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8316a2ec-6968-4c3d-a23d-89c1790bb799 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:17.773622 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8316a2ec-6968-4c3d-a23d-89c1790bb799 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:17.778461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c6cf79c8-066e-4a27-ab81-30475e58250f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:17.778901 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c6cf79c8-066e-4a27-ab81-30475e58250f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:17.779560 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8316a2ec-6968-4c3d-a23d-89c1790bb799 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:17.779668 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c6cf79c8-066e-4a27-ab81-30475e58250f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:17.780007 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8316a2ec-6968-4c3d-a23d-89c1790bb799 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:17.780121 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c6cf79c8-066e-4a27-ab81-30475e58250f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:17.780764 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8316a2ec-6968-4c3d-a23d-89c1790bb799 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:17.781225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8316a2ec-6968-4c3d-a23d-89c1790bb799 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:17.865911 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8316a2ec-6968-4c3d-a23d-89c1790bb799 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:17.874062 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8316a2ec-6968-4c3d-a23d-89c1790bb799 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:17.875690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8316a2ec-6968-4c3d-a23d-89c1790bb799 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:17.876810 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8316a2ec-6968-4c3d-a23d-89c1790bb799 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.107638 Jun 22 10:19:17.877393 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 77/151] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:17 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:17.934829 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c6cf79c8-066e-4a27-ab81-30475e58250f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:17.942290 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c6cf79c8-066e-4a27-ab81-30475e58250f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.174374 Jun 22 10:19:17.942862 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 75/152] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:17 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:18.132894 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2c54ee93-3fe1-49bb-8445-4ef531c1d07e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:18.133493 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2c54ee93-3fe1-49bb-8445-4ef531c1d07e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:18.139343 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c54ee93-3fe1-49bb-8445-4ef531c1d07e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:18.139791 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c54ee93-3fe1-49bb-8445-4ef531c1d07e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:18.140806 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c54ee93-3fe1-49bb-8445-4ef531c1d07e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:18.141255 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c54ee93-3fe1-49bb-8445-4ef531c1d07e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:18.194887 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-edde628d-e745-4636-95b3-dfbb6ec5f7c5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:18.195394 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-edde628d-e745-4636-95b3-dfbb6ec5f7c5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:18.202801 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-edde628d-e745-4636-95b3-dfbb6ec5f7c5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:18.203254 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-edde628d-e745-4636-95b3-dfbb6ec5f7c5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:18.204057 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-edde628d-e745-4636-95b3-dfbb6ec5f7c5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:18.205032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-edde628d-e745-4636-95b3-dfbb6ec5f7c5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:18.218903 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2c54ee93-3fe1-49bb-8445-4ef531c1d07e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:18.227606 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2c54ee93-3fe1-49bb-8445-4ef531c1d07e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.098438 Jun 22 10:19:18.228320 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 78/153] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:18 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:18.333598 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-edde628d-e745-4636-95b3-dfbb6ec5f7c5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:18.341060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-edde628d-e745-4636-95b3-dfbb6ec5f7c5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.149980 Jun 22 10:19:18.341667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 76/154] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:18 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:18.895818 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4614c918-8f2f-4677-8ee1-62177debd9ae tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:18.896455 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4614c918-8f2f-4677-8ee1-62177debd9ae tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:18.902559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4614c918-8f2f-4677-8ee1-62177debd9ae tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:18.903009 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4614c918-8f2f-4677-8ee1-62177debd9ae tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:18.903766 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4614c918-8f2f-4677-8ee1-62177debd9ae tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:18.904201 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4614c918-8f2f-4677-8ee1-62177debd9ae tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:18.958315 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-520acb6c-292e-4ce0-9167-a1c8d50b5fa5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:18.958918 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-520acb6c-292e-4ce0-9167-a1c8d50b5fa5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:18.963580 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4614c918-8f2f-4677-8ee1-62177debd9ae tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:18.965159 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-520acb6c-292e-4ce0-9167-a1c8d50b5fa5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:18.965638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-520acb6c-292e-4ce0-9167-a1c8d50b5fa5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:18.966563 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-520acb6c-292e-4ce0-9167-a1c8d50b5fa5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:18.967020 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-520acb6c-292e-4ce0-9167-a1c8d50b5fa5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:18.972755 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4614c918-8f2f-4677-8ee1-62177debd9ae tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:18.974476 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4614c918-8f2f-4677-8ee1-62177debd9ae tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:18.975621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4614c918-8f2f-4677-8ee1-62177debd9ae tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.084214 Jun 22 10:19:18.986153 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 79/155] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:18 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:19.100458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-520acb6c-292e-4ce0-9167-a1c8d50b5fa5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:19.107945 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-520acb6c-292e-4ce0-9167-a1c8d50b5fa5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.153903 Jun 22 10:19:19.108478 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 77/156] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:18 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:19.243189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-68a570f9-3cee-4016-aa10-3beb8294b511 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:19.243790 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-68a570f9-3cee-4016-aa10-3beb8294b511 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:19.249880 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-68a570f9-3cee-4016-aa10-3beb8294b511 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:19.257808 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-68a570f9-3cee-4016-aa10-3beb8294b511 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:19.257808 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-68a570f9-3cee-4016-aa10-3beb8294b511 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:19.257808 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-68a570f9-3cee-4016-aa10-3beb8294b511 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:19.315609 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-68a570f9-3cee-4016-aa10-3beb8294b511 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:19.322737 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-68a570f9-3cee-4016-aa10-3beb8294b511 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.083264 Jun 22 10:19:19.323390 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 80/157] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:19 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:19.357944 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ac233520-1d12-4390-a9f8-ccc3317b301b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:19.358539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ac233520-1d12-4390-a9f8-ccc3317b301b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:19.365094 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ac233520-1d12-4390-a9f8-ccc3317b301b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:19.365532 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ac233520-1d12-4390-a9f8-ccc3317b301b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:19.367217 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ac233520-1d12-4390-a9f8-ccc3317b301b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:19.367217 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ac233520-1d12-4390-a9f8-ccc3317b301b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:19.491881 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ac233520-1d12-4390-a9f8-ccc3317b301b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:19.499216 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ac233520-1d12-4390-a9f8-ccc3317b301b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.145466 Jun 22 10:19:19.499773 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 78/158] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:19 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:19.993731 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-517b717b-57bf-41bb-bb9a-24483d3c77b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:19.994236 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-517b717b-57bf-41bb-bb9a-24483d3c77b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:20.000450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-517b717b-57bf-41bb-bb9a-24483d3c77b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:20.000924 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-517b717b-57bf-41bb-bb9a-24483d3c77b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:20.001676 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-517b717b-57bf-41bb-bb9a-24483d3c77b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:20.002095 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-517b717b-57bf-41bb-bb9a-24483d3c77b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:20.065037 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-517b717b-57bf-41bb-bb9a-24483d3c77b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:20.073145 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-517b717b-57bf-41bb-bb9a-24483d3c77b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:20.074651 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-517b717b-57bf-41bb-bb9a-24483d3c77b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:20.075751 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-517b717b-57bf-41bb-bb9a-24483d3c77b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.085977 Jun 22 10:19:20.076313 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 81/159] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:19 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:20.124354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-be8b8848-cdc9-4979-a254-04f551d1a0ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:20.124989 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-be8b8848-cdc9-4979-a254-04f551d1a0ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:20.131205 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-be8b8848-cdc9-4979-a254-04f551d1a0ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:20.131645 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-be8b8848-cdc9-4979-a254-04f551d1a0ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:20.132405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-be8b8848-cdc9-4979-a254-04f551d1a0ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:20.132862 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-be8b8848-cdc9-4979-a254-04f551d1a0ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:20.276759 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-be8b8848-cdc9-4979-a254-04f551d1a0ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:20.285097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-be8b8848-cdc9-4979-a254-04f551d1a0ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.164594 Jun 22 10:19:20.285673 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 79/160] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:20 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:20.340798 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-79e96dae-70ae-4638-ad99-8b6c33dc340b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:20.341425 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-79e96dae-70ae-4638-ad99-8b6c33dc340b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:20.348142 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-79e96dae-70ae-4638-ad99-8b6c33dc340b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:20.355130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-79e96dae-70ae-4638-ad99-8b6c33dc340b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:20.355130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-79e96dae-70ae-4638-ad99-8b6c33dc340b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:20.355130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-79e96dae-70ae-4638-ad99-8b6c33dc340b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:20.411294 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-79e96dae-70ae-4638-ad99-8b6c33dc340b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:20.418627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-79e96dae-70ae-4638-ad99-8b6c33dc340b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.081707 Jun 22 10:19:20.419180 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 82/161] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:20 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:20.517496 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-97aa36c7-0d5f-4079-b238-2b114fb9a94e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:20.518024 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-97aa36c7-0d5f-4079-b238-2b114fb9a94e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:20.523996 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-97aa36c7-0d5f-4079-b238-2b114fb9a94e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:20.524447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-97aa36c7-0d5f-4079-b238-2b114fb9a94e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:20.525236 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-97aa36c7-0d5f-4079-b238-2b114fb9a94e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:20.525669 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-97aa36c7-0d5f-4079-b238-2b114fb9a94e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:20.656781 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-97aa36c7-0d5f-4079-b238-2b114fb9a94e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:20.664387 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-97aa36c7-0d5f-4079-b238-2b114fb9a94e tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.151665 Jun 22 10:19:20.664977 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 80/162] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:20 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:21.094191 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-49ffeb67-6b7c-4fe4-98da-cf25c57964d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:21.094724 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-49ffeb67-6b7c-4fe4-98da-cf25c57964d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:21.101193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-49ffeb67-6b7c-4fe4-98da-cf25c57964d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:21.101630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-49ffeb67-6b7c-4fe4-98da-cf25c57964d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:21.105694 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-49ffeb67-6b7c-4fe4-98da-cf25c57964d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:21.105694 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-49ffeb67-6b7c-4fe4-98da-cf25c57964d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:21.164761 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-49ffeb67-6b7c-4fe4-98da-cf25c57964d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:21.172701 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-49ffeb67-6b7c-4fe4-98da-cf25c57964d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:21.174801 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-49ffeb67-6b7c-4fe4-98da-cf25c57964d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:21.175903 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-49ffeb67-6b7c-4fe4-98da-cf25c57964d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.085756 Jun 22 10:19:21.176458 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 83/163] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:21 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:21.303230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e07f8f35-96f5-49a1-bd47-92a86f3e1c45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:21.303847 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e07f8f35-96f5-49a1-bd47-92a86f3e1c45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:21.309989 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e07f8f35-96f5-49a1-bd47-92a86f3e1c45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:21.313100 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e07f8f35-96f5-49a1-bd47-92a86f3e1c45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:21.313100 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e07f8f35-96f5-49a1-bd47-92a86f3e1c45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:21.313100 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e07f8f35-96f5-49a1-bd47-92a86f3e1c45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:21.439537 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ccffeb1b-0cca-4eea-97e2-acb32c7c8848 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:21.439537 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ccffeb1b-0cca-4eea-97e2-acb32c7c8848 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:21.440490 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-e07f8f35-96f5-49a1-bd47-92a86f3e1c45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:21.442542 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ccffeb1b-0cca-4eea-97e2-acb32c7c8848 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:21.442995 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ccffeb1b-0cca-4eea-97e2-acb32c7c8848 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:21.443764 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ccffeb1b-0cca-4eea-97e2-acb32c7c8848 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:21.444201 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ccffeb1b-0cca-4eea-97e2-acb32c7c8848 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:21.447822 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e07f8f35-96f5-49a1-bd47-92a86f3e1c45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.148548 Jun 22 10:19:21.448394 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 81/164] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:21 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:21.507247 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ccffeb1b-0cca-4eea-97e2-acb32c7c8848 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:21.514540 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ccffeb1b-0cca-4eea-97e2-acb32c7c8848 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1307 microversion: 2.1 time: 0.082789 Jun 22 10:19:21.515366 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 84/165] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:21 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1307 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:21.680715 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-20e74a92-1528-465f-a569-5acf44adeb84 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:21.681354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-20e74a92-1528-465f-a569-5acf44adeb84 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:21.687494 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-20e74a92-1528-465f-a569-5acf44adeb84 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:21.687939 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-20e74a92-1528-465f-a569-5acf44adeb84 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:21.688728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-20e74a92-1528-465f-a569-5acf44adeb84 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:21.689188 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-20e74a92-1528-465f-a569-5acf44adeb84 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:21.826355 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-20e74a92-1528-465f-a569-5acf44adeb84 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:21.834231 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-20e74a92-1528-465f-a569-5acf44adeb84 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.157421 Jun 22 10:19:21.834799 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 82/166] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:21 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:22.198788 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d2429344-b001-435e-9c88-3ee607a03ebf tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:22.198788 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d2429344-b001-435e-9c88-3ee607a03ebf tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:22.201624 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d2429344-b001-435e-9c88-3ee607a03ebf tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:22.202182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d2429344-b001-435e-9c88-3ee607a03ebf tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:22.203209 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d2429344-b001-435e-9c88-3ee607a03ebf tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:22.203850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d2429344-b001-435e-9c88-3ee607a03ebf tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:22.466392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-05211c20-1cf7-4fc9-a51a-0890cb7a7250 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:22.467980 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-05211c20-1cf7-4fc9-a51a-0890cb7a7250 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:22.478592 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-05211c20-1cf7-4fc9-a51a-0890cb7a7250 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:22.479134 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-05211c20-1cf7-4fc9-a51a-0890cb7a7250 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:22.479984 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-05211c20-1cf7-4fc9-a51a-0890cb7a7250 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:22.480928 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-05211c20-1cf7-4fc9-a51a-0890cb7a7250 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:22.549288 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d2429344-b001-435e-9c88-3ee607a03ebf tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:22.560691 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d2429344-b001-435e-9c88-3ee607a03ebf tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:22.562293 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d2429344-b001-435e-9c88-3ee607a03ebf tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:22.563676 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d2429344-b001-435e-9c88-3ee607a03ebf tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1333 microversion: 2.20 time: 0.373027 Jun 22 10:19:22.565313 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 85/167] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:22 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1333 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:22.570295 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-eaf30cc0-bd8d-48c7-b00d-f2a2f1bc4ab5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:22.570905 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-eaf30cc0-bd8d-48c7-b00d-f2a2f1bc4ab5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:22.580388 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-eaf30cc0-bd8d-48c7-b00d-f2a2f1bc4ab5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:22.580882 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-eaf30cc0-bd8d-48c7-b00d-f2a2f1bc4ab5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:22.581772 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-eaf30cc0-bd8d-48c7-b00d-f2a2f1bc4ab5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:22.582282 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-eaf30cc0-bd8d-48c7-b00d-f2a2f1bc4ab5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:22.657682 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-eaf30cc0-bd8d-48c7-b00d-f2a2f1bc4ab5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:22.665501 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-eaf30cc0-bd8d-48c7-b00d-f2a2f1bc4ab5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1295 microversion: 2.1 time: 0.098853 Jun 22 10:19:22.673578 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 86/168] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:22 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1295 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:22.704246 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-05211c20-1cf7-4fc9-a51a-0890cb7a7250 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:22.712144 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-05211c20-1cf7-4fc9-a51a-0890cb7a7250 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.252255 Jun 22 10:19:22.712725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 83/169] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:22 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:22.851651 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1bb76774-8bbd-480a-87c4-fae87f498537 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:22.852169 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1bb76774-8bbd-480a-87c4-fae87f498537 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:22.858318 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1bb76774-8bbd-480a-87c4-fae87f498537 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:22.858785 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1bb76774-8bbd-480a-87c4-fae87f498537 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:22.859532 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1bb76774-8bbd-480a-87c4-fae87f498537 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:22.859985 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1bb76774-8bbd-480a-87c4-fae87f498537 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:23.083107 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1bb76774-8bbd-480a-87c4-fae87f498537 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:23.103548 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1bb76774-8bbd-480a-87c4-fae87f498537 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.255673 Jun 22 10:19:23.105918 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 87/170] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:22 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:23.542125 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-af22ea20-3635-443e-88d2-d6370b5cf4cf req-1e85ca20-0afc-4c9c-a3e6-dfe06f3f46c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398fb416-b4c6-4b43-80be-683e1a41721b", "name": "network-vif-plugged", "status": "completed", "tag": "5e03fdc7-3edb-469a-871f-db5cfb33c5e3"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:23.552392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:23.554529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-af22ea20-3635-443e-88d2-d6370b5cf4cf req-1e85ca20-0afc-4c9c-a3e6-dfe06f3f46c7 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:23.554876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-af22ea20-3635-443e-88d2-d6370b5cf4cf req-1e85ca20-0afc-4c9c-a3e6-dfe06f3f46c7 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:23.569181 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-af22ea20-3635-443e-88d2-d6370b5cf4cf req-1e85ca20-0afc-4c9c-a3e6-dfe06f3f46c7 service nova] Creating event network-vif-plugged:5e03fdc7-3edb-469a-871f-db5cfb33c5e3 for instance 398fb416-b4c6-4b43-80be-683e1a41721b on hv-cinder-84327 Jun 22 10:19:23.575303 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-af22ea20-3635-443e-88d2-d6370b5cf4cf req-1e85ca20-0afc-4c9c-a3e6-dfe06f3f46c7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111516 Jun 22 10:19:23.575485 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 84/171] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:23.583211 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c8638902-4ecb-4110-8822-063d3a8b4f64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:23.583830 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c8638902-4ecb-4110-8822-063d3a8b4f64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:23.590756 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c8638902-4ecb-4110-8822-063d3a8b4f64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:23.591437 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c8638902-4ecb-4110-8822-063d3a8b4f64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:23.592580 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c8638902-4ecb-4110-8822-063d3a8b4f64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:23.593082 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c8638902-4ecb-4110-8822-063d3a8b4f64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:23.668322 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c8638902-4ecb-4110-8822-063d3a8b4f64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:23.677065 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c8638902-4ecb-4110-8822-063d3a8b4f64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:23.678650 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c8638902-4ecb-4110-8822-063d3a8b4f64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:23.679730 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c8638902-4ecb-4110-8822-063d3a8b4f64 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1351 microversion: 2.20 time: 0.101472 Jun 22 10:19:23.682027 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 88/172] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:23 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:23.695474 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6614e559-15a1-4782-8c31-acdf27779743 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:23.696281 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6614e559-15a1-4782-8c31-acdf27779743 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:23.703088 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6614e559-15a1-4782-8c31-acdf27779743 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:23.703397 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6614e559-15a1-4782-8c31-acdf27779743 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:23.705416 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6614e559-15a1-4782-8c31-acdf27779743 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:23.706388 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6614e559-15a1-4782-8c31-acdf27779743 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:23.729233 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-75bd4c38-f2c7-4a4f-a1ed-a85413a57f4b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:23.729832 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-75bd4c38-f2c7-4a4f-a1ed-a85413a57f4b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:23.736185 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-75bd4c38-f2c7-4a4f-a1ed-a85413a57f4b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:23.736661 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-75bd4c38-f2c7-4a4f-a1ed-a85413a57f4b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:23.737451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-75bd4c38-f2c7-4a4f-a1ed-a85413a57f4b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:23.737951 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-75bd4c38-f2c7-4a4f-a1ed-a85413a57f4b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:23.911617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6614e559-15a1-4782-8c31-acdf27779743 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:23.927616 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6614e559-15a1-4782-8c31-acdf27779743 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.243506 Jun 22 10:19:23.927616 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 85/173] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:23 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:23.928278 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-75bd4c38-f2c7-4a4f-a1ed-a85413a57f4b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:23.936158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-75bd4c38-f2c7-4a4f-a1ed-a85413a57f4b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.211107 Jun 22 10:19:23.936728 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 89/174] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:23 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:24.124448 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d90a19ea-c77b-4aca-a957-bd3544daad1d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:24.124448 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d90a19ea-c77b-4aca-a957-bd3544daad1d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:24.129304 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d90a19ea-c77b-4aca-a957-bd3544daad1d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:24.129881 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d90a19ea-c77b-4aca-a957-bd3544daad1d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:24.131027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d90a19ea-c77b-4aca-a957-bd3544daad1d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:24.131667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d90a19ea-c77b-4aca-a957-bd3544daad1d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:24.272346 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d90a19ea-c77b-4aca-a957-bd3544daad1d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:24.282031 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d90a19ea-c77b-4aca-a957-bd3544daad1d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.164226 Jun 22 10:19:24.282654 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 86/175] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:24 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:24.698699 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-aa653e97-efc6-41df-a005-26f189ea912e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:24.699321 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-aa653e97-efc6-41df-a005-26f189ea912e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:24.705980 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aa653e97-efc6-41df-a005-26f189ea912e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:24.706426 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aa653e97-efc6-41df-a005-26f189ea912e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:24.707201 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aa653e97-efc6-41df-a005-26f189ea912e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:24.707638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aa653e97-efc6-41df-a005-26f189ea912e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:24.770015 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-aa653e97-efc6-41df-a005-26f189ea912e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:24.778152 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-aa653e97-efc6-41df-a005-26f189ea912e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:24.779670 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-aa653e97-efc6-41df-a005-26f189ea912e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:24.780775 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-aa653e97-efc6-41df-a005-26f189ea912e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1351 microversion: 2.20 time: 0.086334 Jun 22 10:19:24.781533 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 90/176] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:24 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:24.942935 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2278bf8d-1f32-4b9f-a2e5-a5fc9354d630 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:24.943472 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2278bf8d-1f32-4b9f-a2e5-a5fc9354d630 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:24.952726 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2278bf8d-1f32-4b9f-a2e5-a5fc9354d630 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:24.953196 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2278bf8d-1f32-4b9f-a2e5-a5fc9354d630 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:24.953966 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2278bf8d-1f32-4b9f-a2e5-a5fc9354d630 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:24.954447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2278bf8d-1f32-4b9f-a2e5-a5fc9354d630 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:24.964753 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c4937d27-2f81-4058-9033-027e160ad765 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:24.973013 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c4937d27-2f81-4058-9033-027e160ad765 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:24.980931 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c4937d27-2f81-4058-9033-027e160ad765 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:24.981622 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c4937d27-2f81-4058-9033-027e160ad765 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:24.982670 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c4937d27-2f81-4058-9033-027e160ad765 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:24.983279 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c4937d27-2f81-4058-9033-027e160ad765 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:25.167856 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2278bf8d-1f32-4b9f-a2e5-a5fc9354d630 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:25.176615 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2278bf8d-1f32-4b9f-a2e5-a5fc9354d630 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.238190 Jun 22 10:19:25.177499 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 87/177] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:24 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:25.184292 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c4937d27-2f81-4058-9033-027e160ad765 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:25.192475 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c4937d27-2f81-4058-9033-027e160ad765 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.243207 Jun 22 10:19:25.193160 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 91/178] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:24 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:25.301926 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7f865231-7ee9-46df-ad1f-7d26bf9665d5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:25.302535 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7f865231-7ee9-46df-ad1f-7d26bf9665d5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:25.308709 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7f865231-7ee9-46df-ad1f-7d26bf9665d5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:25.317889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7f865231-7ee9-46df-ad1f-7d26bf9665d5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:25.317889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7f865231-7ee9-46df-ad1f-7d26bf9665d5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:25.317889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7f865231-7ee9-46df-ad1f-7d26bf9665d5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:25.445846 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7f865231-7ee9-46df-ad1f-7d26bf9665d5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:25.453278 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7f865231-7ee9-46df-ad1f-7d26bf9665d5 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.155864 Jun 22 10:19:25.453842 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 88/179] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:25 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:25.798664 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a627c7fb-a748-40e6-971f-2d47806491ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:25.799267 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a627c7fb-a748-40e6-971f-2d47806491ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:25.805555 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a627c7fb-a748-40e6-971f-2d47806491ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:25.806000 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a627c7fb-a748-40e6-971f-2d47806491ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:25.806800 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a627c7fb-a748-40e6-971f-2d47806491ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:25.807227 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a627c7fb-a748-40e6-971f-2d47806491ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:25.868638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a627c7fb-a748-40e6-971f-2d47806491ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:25.876695 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a627c7fb-a748-40e6-971f-2d47806491ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:25.878237 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a627c7fb-a748-40e6-971f-2d47806491ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:25.879334 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a627c7fb-a748-40e6-971f-2d47806491ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1351 microversion: 2.20 time: 0.085169 Jun 22 10:19:25.879888 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 92/180] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:25 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:26.193601 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e64a8143-4e5a-44ff-b1d5-eff5592df2b9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:26.194146 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e64a8143-4e5a-44ff-b1d5-eff5592df2b9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:26.200367 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e64a8143-4e5a-44ff-b1d5-eff5592df2b9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:26.200843 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e64a8143-4e5a-44ff-b1d5-eff5592df2b9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:26.201615 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e64a8143-4e5a-44ff-b1d5-eff5592df2b9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:26.202083 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e64a8143-4e5a-44ff-b1d5-eff5592df2b9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:26.209368 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-86c1b64f-786e-4afd-819d-503747f56a3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:26.209976 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-86c1b64f-786e-4afd-819d-503747f56a3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:26.215897 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-86c1b64f-786e-4afd-819d-503747f56a3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:26.216342 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-86c1b64f-786e-4afd-819d-503747f56a3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:26.217133 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-86c1b64f-786e-4afd-819d-503747f56a3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:26.217573 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-86c1b64f-786e-4afd-819d-503747f56a3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:26.223003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:26.398849 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-e64a8143-4e5a-44ff-b1d5-eff5592df2b9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:26.403145 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-86c1b64f-786e-4afd-819d-503747f56a3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:26.406976 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e64a8143-4e5a-44ff-b1d5-eff5592df2b9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.217289 Jun 22 10:19:26.407997 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 89/181] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:26 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:26.415473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-86c1b64f-786e-4afd-819d-503747f56a3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.209828 Jun 22 10:19:26.425155 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 93/182] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:26 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:26.470570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b0339db5-d98c-43ba-a5bd-0eb925e4d47b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:26.471187 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b0339db5-d98c-43ba-a5bd-0eb925e4d47b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:26.477420 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b0339db5-d98c-43ba-a5bd-0eb925e4d47b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:26.477873 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b0339db5-d98c-43ba-a5bd-0eb925e4d47b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:26.478634 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b0339db5-d98c-43ba-a5bd-0eb925e4d47b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:26.479071 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b0339db5-d98c-43ba-a5bd-0eb925e4d47b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:26.498134 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:26.607869 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b0339db5-d98c-43ba-a5bd-0eb925e4d47b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:26.615923 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b0339db5-d98c-43ba-a5bd-0eb925e4d47b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.149750 Jun 22 10:19:26.616487 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 90/183] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:26 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:26.897466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-85148198-5511-43d9-91b7-18c223b7a958 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:26.898156 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-85148198-5511-43d9-91b7-18c223b7a958 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:26.900019 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:26.905433 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-85148198-5511-43d9-91b7-18c223b7a958 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:26.905891 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-85148198-5511-43d9-91b7-18c223b7a958 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:26.906665 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-85148198-5511-43d9-91b7-18c223b7a958 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:26.907144 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-85148198-5511-43d9-91b7-18c223b7a958 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:26.968359 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-85148198-5511-43d9-91b7-18c223b7a958 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:26.976961 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-85148198-5511-43d9-91b7-18c223b7a958 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:26.978466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-85148198-5511-43d9-91b7-18c223b7a958 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:26.979553 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-85148198-5511-43d9-91b7-18c223b7a958 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1351 microversion: 2.20 time: 0.086040 Jun 22 10:19:26.980104 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 94/184] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:26 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:27.424093 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0f81e115-f254-4062-8691-43f125aefc8f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:27.424700 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0f81e115-f254-4062-8691-43f125aefc8f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:27.431354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0f81e115-f254-4062-8691-43f125aefc8f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:27.431841 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0f81e115-f254-4062-8691-43f125aefc8f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:27.432611 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0f81e115-f254-4062-8691-43f125aefc8f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:27.433072 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0f81e115-f254-4062-8691-43f125aefc8f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:27.433635 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0966417a-9e23-44a9-bc60-5c5b0b2bf6db tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:27.434241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0966417a-9e23-44a9-bc60-5c5b0b2bf6db tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:27.441020 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0966417a-9e23-44a9-bc60-5c5b0b2bf6db tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:27.441469 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0966417a-9e23-44a9-bc60-5c5b0b2bf6db tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:27.442235 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0966417a-9e23-44a9-bc60-5c5b0b2bf6db tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:27.442672 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0966417a-9e23-44a9-bc60-5c5b0b2bf6db tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:27.633347 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0f81e115-f254-4062-8691-43f125aefc8f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:27.636322 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0966417a-9e23-44a9-bc60-5c5b0b2bf6db tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:27.641336 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0f81e115-f254-4062-8691-43f125aefc8f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.221029 Jun 22 10:19:27.641922 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 91/185] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:27 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:27.644109 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0966417a-9e23-44a9-bc60-5c5b0b2bf6db tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.214839 Jun 22 10:19:27.644744 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 95/186] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:27 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:27.646569 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e83f2033-057d-4d35-9fc0-cbddeaaaad66 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:27.647175 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e83f2033-057d-4d35-9fc0-cbddeaaaad66 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:27.653582 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e83f2033-057d-4d35-9fc0-cbddeaaaad66 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:27.654026 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e83f2033-057d-4d35-9fc0-cbddeaaaad66 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:27.654776 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e83f2033-057d-4d35-9fc0-cbddeaaaad66 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:27.655205 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e83f2033-057d-4d35-9fc0-cbddeaaaad66 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:27.784191 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-e83f2033-057d-4d35-9fc0-cbddeaaaad66 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:27.791593 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e83f2033-057d-4d35-9fc0-cbddeaaaad66 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.148721 Jun 22 10:19:27.792158 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 92/187] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:27 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:28.006447 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-94b8ffc1-61e1-4846-a9eb-3ed17ce706cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:28.006950 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-94b8ffc1-61e1-4846-a9eb-3ed17ce706cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:28.012897 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-94b8ffc1-61e1-4846-a9eb-3ed17ce706cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:28.013341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-94b8ffc1-61e1-4846-a9eb-3ed17ce706cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:28.014083 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-94b8ffc1-61e1-4846-a9eb-3ed17ce706cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:28.014764 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-94b8ffc1-61e1-4846-a9eb-3ed17ce706cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:28.075056 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-94b8ffc1-61e1-4846-a9eb-3ed17ce706cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:28.083947 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-94b8ffc1-61e1-4846-a9eb-3ed17ce706cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:28.085479 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-94b8ffc1-61e1-4846-a9eb-3ed17ce706cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:28.086578 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-94b8ffc1-61e1-4846-a9eb-3ed17ce706cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1351 microversion: 2.20 time: 0.084398 Jun 22 10:19:28.087139 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 96/188] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:28 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:28.658094 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-98f942a6-d4c5-4e7d-9d8b-431e8e32214f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:28.658704 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-98f942a6-d4c5-4e7d-9d8b-431e8e32214f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:28.660421 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-939258e3-6264-4c27-9fe0-5a4b96770a0b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:28.661056 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-939258e3-6264-4c27-9fe0-5a4b96770a0b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:28.667544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-98f942a6-d4c5-4e7d-9d8b-431e8e32214f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:28.667544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-98f942a6-d4c5-4e7d-9d8b-431e8e32214f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:28.667544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-98f942a6-d4c5-4e7d-9d8b-431e8e32214f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:28.667544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-98f942a6-d4c5-4e7d-9d8b-431e8e32214f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:28.667965 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-939258e3-6264-4c27-9fe0-5a4b96770a0b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:28.667965 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-939258e3-6264-4c27-9fe0-5a4b96770a0b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:28.668485 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-939258e3-6264-4c27-9fe0-5a4b96770a0b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:28.669106 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-939258e3-6264-4c27-9fe0-5a4b96770a0b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:28.862380 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-98f942a6-d4c5-4e7d-9d8b-431e8e32214f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:28.865236 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-939258e3-6264-4c27-9fe0-5a4b96770a0b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:28.869836 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-98f942a6-d4c5-4e7d-9d8b-431e8e32214f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.215908 Jun 22 10:19:28.873628 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 93/189] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:28 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:28.873973 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-939258e3-6264-4c27-9fe0-5a4b96770a0b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.216259 Jun 22 10:19:28.875073 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9fc81ae3-0b71-4027-8428-2ab3c57f1a89 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:28.875677 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9fc81ae3-0b71-4027-8428-2ab3c57f1a89 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:28.881028 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 97/190] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:28 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:28.881815 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9fc81ae3-0b71-4027-8428-2ab3c57f1a89 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:28.882307 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9fc81ae3-0b71-4027-8428-2ab3c57f1a89 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:28.883100 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9fc81ae3-0b71-4027-8428-2ab3c57f1a89 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:28.883529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9fc81ae3-0b71-4027-8428-2ab3c57f1a89 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:29.011067 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9fc81ae3-0b71-4027-8428-2ab3c57f1a89 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:29.018983 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9fc81ae3-0b71-4027-8428-2ab3c57f1a89 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.147494 Jun 22 10:19:29.019553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 94/191] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:28 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:29.103245 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ff7c7b8f-dbd4-4aa8-8038-28f8ed0ec11c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:29.103840 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ff7c7b8f-dbd4-4aa8-8038-28f8ed0ec11c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:29.109877 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ff7c7b8f-dbd4-4aa8-8038-28f8ed0ec11c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:29.110331 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ff7c7b8f-dbd4-4aa8-8038-28f8ed0ec11c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:29.111074 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ff7c7b8f-dbd4-4aa8-8038-28f8ed0ec11c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:29.111495 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ff7c7b8f-dbd4-4aa8-8038-28f8ed0ec11c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:29.173719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ff7c7b8f-dbd4-4aa8-8038-28f8ed0ec11c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:29.181492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ff7c7b8f-dbd4-4aa8-8038-28f8ed0ec11c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:29.182983 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ff7c7b8f-dbd4-4aa8-8038-28f8ed0ec11c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:29.184072 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ff7c7b8f-dbd4-4aa8-8038-28f8ed0ec11c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1351 microversion: 2.20 time: 0.084630 Jun 22 10:19:29.184623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 98/192] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:29 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:29.887468 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-471ab570-a551-4bb2-ab46-b42aff6adfc5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:29.888075 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-471ab570-a551-4bb2-ab46-b42aff6adfc5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:29.889638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6ca607f7-641a-4897-b274-1fccee3e136c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:29.890255 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6ca607f7-641a-4897-b274-1fccee3e136c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:29.898974 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-471ab570-a551-4bb2-ab46-b42aff6adfc5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:29.899338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-471ab570-a551-4bb2-ab46-b42aff6adfc5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:29.900124 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-471ab570-a551-4bb2-ab46-b42aff6adfc5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:29.900567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-471ab570-a551-4bb2-ab46-b42aff6adfc5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:29.902939 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6ca607f7-641a-4897-b274-1fccee3e136c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:29.913103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6ca607f7-641a-4897-b274-1fccee3e136c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:29.913103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6ca607f7-641a-4897-b274-1fccee3e136c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:29.913103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6ca607f7-641a-4897-b274-1fccee3e136c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:30.284234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6ca607f7-641a-4897-b274-1fccee3e136c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:30.293774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6ca607f7-641a-4897-b274-1fccee3e136c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.407883 Jun 22 10:19:30.294234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 99/193] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:29 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:30.299580 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f0d429e3-81af-4de8-bbab-f63c74278c97 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:30.300239 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f0d429e3-81af-4de8-bbab-f63c74278c97 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:30.307342 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f0d429e3-81af-4de8-bbab-f63c74278c97 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:30.311727 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f0d429e3-81af-4de8-bbab-f63c74278c97 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:30.311727 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f0d429e3-81af-4de8-bbab-f63c74278c97 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:30.311727 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f0d429e3-81af-4de8-bbab-f63c74278c97 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:30.312080 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-471ab570-a551-4bb2-ab46-b42aff6adfc5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:30.321506 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-471ab570-a551-4bb2-ab46-b42aff6adfc5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.438370 Jun 22 10:19:30.322174 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 95/194] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:29 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:30.326949 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4f8b9c8f-1035-4213-8a9a-abc8fcc0fe83 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:30.327615 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4f8b9c8f-1035-4213-8a9a-abc8fcc0fe83 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:30.335923 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f8b9c8f-1035-4213-8a9a-abc8fcc0fe83 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:30.336739 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f8b9c8f-1035-4213-8a9a-abc8fcc0fe83 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:30.341298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f8b9c8f-1035-4213-8a9a-abc8fcc0fe83 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:30.341298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f8b9c8f-1035-4213-8a9a-abc8fcc0fe83 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:30.411144 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4f8b9c8f-1035-4213-8a9a-abc8fcc0fe83 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:30.422068 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4f8b9c8f-1035-4213-8a9a-abc8fcc0fe83 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:30.423637 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4f8b9c8f-1035-4213-8a9a-abc8fcc0fe83 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:30.427418 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4f8b9c8f-1035-4213-8a9a-abc8fcc0fe83 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1339 microversion: 2.20 time: 0.101584 Jun 22 10:19:30.429426 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 96/195] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:30 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:30.486920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f0d429e3-81af-4de8-bbab-f63c74278c97 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:30.493956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f0d429e3-81af-4de8-bbab-f63c74278c97 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.198306 Jun 22 10:19:30.494902 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 100/196] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:30 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:30.755127 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-f14bd915-3fcb-4490-8ed2-98001c6502b8 req-f5b90373-a971-4488-bd70-0a937c8e6217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5", "tag": "54ad74cf-b62f-42ef-8cee-15d7aef7f8e7"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:30.764704 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-f14bd915-3fcb-4490-8ed2-98001c6502b8 req-f5b90373-a971-4488-bd70-0a937c8e6217 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:30.765329 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-f14bd915-3fcb-4490-8ed2-98001c6502b8 req-f5b90373-a971-4488-bd70-0a937c8e6217 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:30.777700 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-f14bd915-3fcb-4490-8ed2-98001c6502b8 req-f5b90373-a971-4488-bd70-0a937c8e6217 service nova] Creating event network-changed:54ad74cf-b62f-42ef-8cee-15d7aef7f8e7 for instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 on hv-cinder-84327 Jun 22 10:19:30.782761 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-f14bd915-3fcb-4490-8ed2-98001c6502b8 req-f5b90373-a971-4488-bd70-0a937c8e6217 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110502 Jun 22 10:19:30.785346 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 97/197] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:31.310497 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-60d5a21c-93bd-46a8-8cb9-7c558cb532aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:31.311149 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-60d5a21c-93bd-46a8-8cb9-7c558cb532aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:31.317997 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-60d5a21c-93bd-46a8-8cb9-7c558cb532aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.318446 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-60d5a21c-93bd-46a8-8cb9-7c558cb532aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.319213 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-60d5a21c-93bd-46a8-8cb9-7c558cb532aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.319645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-60d5a21c-93bd-46a8-8cb9-7c558cb532aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.339415 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-772e9f92-7bb7-42f6-b342-4c5159955b0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:31.340117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-772e9f92-7bb7-42f6-b342-4c5159955b0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:31.346514 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-772e9f92-7bb7-42f6-b342-4c5159955b0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.346962 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-772e9f92-7bb7-42f6-b342-4c5159955b0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.347740 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-772e9f92-7bb7-42f6-b342-4c5159955b0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.348172 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-772e9f92-7bb7-42f6-b342-4c5159955b0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.499785 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-60d5a21c-93bd-46a8-8cb9-7c558cb532aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:31.508209 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-60d5a21c-93bd-46a8-8cb9-7c558cb532aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.201511 Jun 22 10:19:31.508785 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 101/198] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:31 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:31.517895 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c523d0ac-07f9-4ac4-aaaf-20a1c87503c1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:31.517895 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c523d0ac-07f9-4ac4-aaaf-20a1c87503c1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:31.520335 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c523d0ac-07f9-4ac4-aaaf-20a1c87503c1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.520783 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c523d0ac-07f9-4ac4-aaaf-20a1c87503c1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.521575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c523d0ac-07f9-4ac4-aaaf-20a1c87503c1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.522012 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c523d0ac-07f9-4ac4-aaaf-20a1c87503c1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.526007 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-772e9f92-7bb7-42f6-b342-4c5159955b0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:31.533807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-772e9f92-7bb7-42f6-b342-4c5159955b0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.198714 Jun 22 10:19:31.534370 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 98/199] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:31 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:31.538730 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7f1bb7ec-5d8d-4cf0-8dc0-36f03a582edb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:31.539307 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7f1bb7ec-5d8d-4cf0-8dc0-36f03a582edb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:31.546161 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7f1bb7ec-5d8d-4cf0-8dc0-36f03a582edb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.546615 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7f1bb7ec-5d8d-4cf0-8dc0-36f03a582edb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.548018 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7f1bb7ec-5d8d-4cf0-8dc0-36f03a582edb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.548460 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7f1bb7ec-5d8d-4cf0-8dc0-36f03a582edb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.719558 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c523d0ac-07f9-4ac4-aaaf-20a1c87503c1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:31.724098 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7f1bb7ec-5d8d-4cf0-8dc0-36f03a582edb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:31.727711 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c523d0ac-07f9-4ac4-aaaf-20a1c87503c1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:31.729246 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c523d0ac-07f9-4ac4-aaaf-20a1c87503c1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:31.730342 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c523d0ac-07f9-4ac4-aaaf-20a1c87503c1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.220626 Jun 22 10:19:31.730896 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 102/200] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:31 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:31.731385 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7f1bb7ec-5d8d-4cf0-8dc0-36f03a582edb tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.196063 Jun 22 10:19:31.732104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 99/201] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:31 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:32.525560 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ed500944-07f7-4de0-a91d-1f7af40f8132 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:32.526101 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ed500944-07f7-4de0-a91d-1f7af40f8132 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:32.532109 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ed500944-07f7-4de0-a91d-1f7af40f8132 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:32.532556 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ed500944-07f7-4de0-a91d-1f7af40f8132 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:32.533420 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ed500944-07f7-4de0-a91d-1f7af40f8132 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:32.533854 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ed500944-07f7-4de0-a91d-1f7af40f8132 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:32.550745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1009d5e9-ad4c-458d-a173-2968d060deb7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:32.551350 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1009d5e9-ad4c-458d-a173-2968d060deb7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:32.557267 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1009d5e9-ad4c-458d-a173-2968d060deb7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:32.557708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1009d5e9-ad4c-458d-a173-2968d060deb7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:32.558469 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1009d5e9-ad4c-458d-a173-2968d060deb7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:32.558905 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1009d5e9-ad4c-458d-a173-2968d060deb7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:32.731055 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ed500944-07f7-4de0-a91d-1f7af40f8132 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:32.735074 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1009d5e9-ad4c-458d-a173-2968d060deb7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:32.738666 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ed500944-07f7-4de0-a91d-1f7af40f8132 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.217032 Jun 22 10:19:32.739241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 103/202] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:32 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:32.743540 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1009d5e9-ad4c-458d-a173-2968d060deb7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.196314 Jun 22 10:19:32.748496 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 100/203] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:32 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:32.749226 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bf4b3524-45f9-4d8f-8fb6-a6210ff0a8ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:32.749909 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bf4b3524-45f9-4d8f-8fb6-a6210ff0a8ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:32.753557 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c3bd66e6-1d0e-46c6-b959-15f392fb8904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:32.754167 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c3bd66e6-1d0e-46c6-b959-15f392fb8904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:32.756371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bf4b3524-45f9-4d8f-8fb6-a6210ff0a8ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:32.757068 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bf4b3524-45f9-4d8f-8fb6-a6210ff0a8ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:32.757745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bf4b3524-45f9-4d8f-8fb6-a6210ff0a8ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:32.758171 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bf4b3524-45f9-4d8f-8fb6-a6210ff0a8ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:32.761074 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c3bd66e6-1d0e-46c6-b959-15f392fb8904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:32.761592 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c3bd66e6-1d0e-46c6-b959-15f392fb8904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:32.762357 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c3bd66e6-1d0e-46c6-b959-15f392fb8904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:32.762793 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c3bd66e6-1d0e-46c6-b959-15f392fb8904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:32.958099 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bf4b3524-45f9-4d8f-8fb6-a6210ff0a8ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:32.965642 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bf4b3524-45f9-4d8f-8fb6-a6210ff0a8ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.220421 Jun 22 10:19:32.966021 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c3bd66e6-1d0e-46c6-b959-15f392fb8904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:32.966538 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 104/204] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:32 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:32.974280 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c3bd66e6-1d0e-46c6-b959-15f392fb8904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:32.975778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c3bd66e6-1d0e-46c6-b959-15f392fb8904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:32.976931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c3bd66e6-1d0e-46c6-b959-15f392fb8904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.227332 Jun 22 10:19:32.977483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 101/205] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:32 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:33.755786 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4f31cc57-ece6-446a-a789-b70f4abe7fed tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:33.756403 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4f31cc57-ece6-446a-a789-b70f4abe7fed tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:33.758955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ddebb753-1979-4eb3-ae13-4a885dcc92d8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:33.759563 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ddebb753-1979-4eb3-ae13-4a885dcc92d8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:33.762571 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4f31cc57-ece6-446a-a789-b70f4abe7fed tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:33.763019 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4f31cc57-ece6-446a-a789-b70f4abe7fed tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:33.764034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4f31cc57-ece6-446a-a789-b70f4abe7fed tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:33.764470 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4f31cc57-ece6-446a-a789-b70f4abe7fed tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:33.765690 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ddebb753-1979-4eb3-ae13-4a885dcc92d8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:33.766138 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ddebb753-1979-4eb3-ae13-4a885dcc92d8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:33.766896 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ddebb753-1979-4eb3-ae13-4a885dcc92d8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:33.767330 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ddebb753-1979-4eb3-ae13-4a885dcc92d8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:33.969647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4f31cc57-ece6-446a-a789-b70f4abe7fed tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:33.976152 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ddebb753-1979-4eb3-ae13-4a885dcc92d8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:33.979458 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4f31cc57-ece6-446a-a789-b70f4abe7fed tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.227579 Jun 22 10:19:33.980539 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 105/206] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:33 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:33.984215 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ddebb753-1979-4eb3-ae13-4a885dcc92d8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.228848 Jun 22 10:19:33.986427 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a443ad5e-625b-476e-865f-b32686dd5d81 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:33.987334 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a443ad5e-625b-476e-865f-b32686dd5d81 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:33.993721 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a443ad5e-625b-476e-865f-b32686dd5d81 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:33.994443 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a443ad5e-625b-476e-865f-b32686dd5d81 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:33.995153 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 102/207] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:33 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:33.995430 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a443ad5e-625b-476e-865f-b32686dd5d81 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:33.995965 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a443ad5e-625b-476e-865f-b32686dd5d81 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:34.005214 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b3a22905-3073-4168-b949-54a6396a177d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:34.005909 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b3a22905-3073-4168-b949-54a6396a177d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:34.012083 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b3a22905-3073-4168-b949-54a6396a177d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:34.012523 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b3a22905-3073-4168-b949-54a6396a177d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:34.013334 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b3a22905-3073-4168-b949-54a6396a177d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:34.014012 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b3a22905-3073-4168-b949-54a6396a177d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:34.207234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a443ad5e-625b-476e-865f-b32686dd5d81 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:34.215968 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a443ad5e-625b-476e-865f-b32686dd5d81 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.232932 Jun 22 10:19:34.223700 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b3a22905-3073-4168-b949-54a6396a177d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:34.224791 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 106/208] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:33 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:34.233305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b3a22905-3073-4168-b949-54a6396a177d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:34.235729 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b3a22905-3073-4168-b949-54a6396a177d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:34.236784 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b3a22905-3073-4168-b949-54a6396a177d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.240527 Jun 22 10:19:34.237267 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 103/209] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:33 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:34.997324 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-21099b85-8914-49c7-9f18-b9d5b9d84191 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:34.997853 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-21099b85-8914-49c7-9f18-b9d5b9d84191 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:35.000214 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0ad89d7e-0297-4ad0-bcb0-8f467aa865bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:35.001410 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0ad89d7e-0297-4ad0-bcb0-8f467aa865bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:35.004432 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-21099b85-8914-49c7-9f18-b9d5b9d84191 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:35.004978 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-21099b85-8914-49c7-9f18-b9d5b9d84191 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:35.007819 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-21099b85-8914-49c7-9f18-b9d5b9d84191 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:35.007819 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-21099b85-8914-49c7-9f18-b9d5b9d84191 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:35.008061 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0ad89d7e-0297-4ad0-bcb0-8f467aa865bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:35.008061 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0ad89d7e-0297-4ad0-bcb0-8f467aa865bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:35.008751 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0ad89d7e-0297-4ad0-bcb0-8f467aa865bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:35.009119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0ad89d7e-0297-4ad0-bcb0-8f467aa865bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:35.416933 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-21099b85-8914-49c7-9f18-b9d5b9d84191 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:35.417098 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0ad89d7e-0297-4ad0-bcb0-8f467aa865bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:35.420034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-21099b85-8914-49c7-9f18-b9d5b9d84191 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.426621 Jun 22 10:19:35.420812 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 107/210] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:34 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:35.425239 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0ad89d7e-0297-4ad0-bcb0-8f467aa865bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.428302 Jun 22 10:19:35.425471 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-cfc7ae4f-561c-4f9a-9ff7-f83b1cb30f0d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:35.425940 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 104/211] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:34 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:35.426123 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-cfc7ae4f-561c-4f9a-9ff7-f83b1cb30f0d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:35.431508 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c5b845e7-e086-409f-beab-ae9300e0dad9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:35.434530 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c5b845e7-e086-409f-beab-ae9300e0dad9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:35.434659 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cfc7ae4f-561c-4f9a-9ff7-f83b1cb30f0d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:35.434659 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cfc7ae4f-561c-4f9a-9ff7-f83b1cb30f0d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:35.435286 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cfc7ae4f-561c-4f9a-9ff7-f83b1cb30f0d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:35.435719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cfc7ae4f-561c-4f9a-9ff7-f83b1cb30f0d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:35.439125 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5b845e7-e086-409f-beab-ae9300e0dad9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:35.439574 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5b845e7-e086-409f-beab-ae9300e0dad9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:35.440339 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5b845e7-e086-409f-beab-ae9300e0dad9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:35.440772 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5b845e7-e086-409f-beab-ae9300e0dad9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:35.631325 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c5b845e7-e086-409f-beab-ae9300e0dad9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:35.638546 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-cfc7ae4f-561c-4f9a-9ff7-f83b1cb30f0d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:35.639863 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c5b845e7-e086-409f-beab-ae9300e0dad9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:35.642014 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c5b845e7-e086-409f-beab-ae9300e0dad9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:35.643045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c5b845e7-e086-409f-beab-ae9300e0dad9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.215912 Jun 22 10:19:35.644120 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 105/212] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:35 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:35.648100 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-cfc7ae4f-561c-4f9a-9ff7-f83b1cb30f0d tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.226253 Jun 22 10:19:35.648227 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-2d4f591e-227e-4169-8418-5c00adf2b250 req-32625570-fc24-4418-b4b6-4b282393d42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2acd1a7-4078-4955-ab65-12d905064011", "name": "network-vif-plugged", "status": "completed", "tag": "e9e20178-585d-42d5-a786-c8d8f9ddf6d7"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:35.648953 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 108/213] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:35 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:35.656156 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-2d4f591e-227e-4169-8418-5c00adf2b250 req-32625570-fc24-4418-b4b6-4b282393d42f service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:35.656587 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-2d4f591e-227e-4169-8418-5c00adf2b250 req-32625570-fc24-4418-b4b6-4b282393d42f service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:35.674609 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-2d4f591e-227e-4169-8418-5c00adf2b250 req-32625570-fc24-4418-b4b6-4b282393d42f service nova] Creating event network-vif-plugged:e9e20178-585d-42d5-a786-c8d8f9ddf6d7 for instance c2acd1a7-4078-4955-ab65-12d905064011 on hv-cinder-84327 Jun 22 10:19:35.680073 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-2d4f591e-227e-4169-8418-5c00adf2b250 req-32625570-fc24-4418-b4b6-4b282393d42f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035056 Jun 22 10:19:35.681078 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 106/214] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:36.437641 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f46818a7-3422-4604-9df4-bb7e5d7963b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:36.438819 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f46818a7-3422-4604-9df4-bb7e5d7963b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:36.443741 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e6dfd7b7-3bb7-40e9-8222-250e8d405005 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:36.444465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e6dfd7b7-3bb7-40e9-8222-250e8d405005 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:36.444886 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f46818a7-3422-4604-9df4-bb7e5d7963b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:36.445336 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f46818a7-3422-4604-9df4-bb7e5d7963b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:36.446137 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f46818a7-3422-4604-9df4-bb7e5d7963b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:36.446559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f46818a7-3422-4604-9df4-bb7e5d7963b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:36.451267 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e6dfd7b7-3bb7-40e9-8222-250e8d405005 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:36.451711 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e6dfd7b7-3bb7-40e9-8222-250e8d405005 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:36.452464 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e6dfd7b7-3bb7-40e9-8222-250e8d405005 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:36.452911 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e6dfd7b7-3bb7-40e9-8222-250e8d405005 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:36.642683 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f46818a7-3422-4604-9df4-bb7e5d7963b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:36.650320 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-e6dfd7b7-3bb7-40e9-8222-250e8d405005 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:36.650499 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:36.652880 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f46818a7-3422-4604-9df4-bb7e5d7963b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.220414 Jun 22 10:19:36.653670 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 109/215] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:36 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:36.655305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e6dfd7b7-3bb7-40e9-8222-250e8d405005 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.215825 Jun 22 10:19:36.656080 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 107/216] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:36 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:36.669056 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8771d5c2-42ae-4e47-9832-7798be1e4f3a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:36.669938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8771d5c2-42ae-4e47-9832-7798be1e4f3a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:36.675166 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-285e9762-9153-4905-aa06-5706f6a317a5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:36.676086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-285e9762-9153-4905-aa06-5706f6a317a5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:36.677221 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8771d5c2-42ae-4e47-9832-7798be1e4f3a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:36.677669 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8771d5c2-42ae-4e47-9832-7798be1e4f3a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:36.678435 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8771d5c2-42ae-4e47-9832-7798be1e4f3a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:36.679098 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8771d5c2-42ae-4e47-9832-7798be1e4f3a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:36.688037 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-285e9762-9153-4905-aa06-5706f6a317a5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:36.696021 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-285e9762-9153-4905-aa06-5706f6a317a5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:36.696021 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-285e9762-9153-4905-aa06-5706f6a317a5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:36.696021 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-285e9762-9153-4905-aa06-5706f6a317a5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:36.708895 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:36.885446 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8771d5c2-42ae-4e47-9832-7798be1e4f3a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:36.890719 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-285e9762-9153-4905-aa06-5706f6a317a5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:36.894240 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8771d5c2-42ae-4e47-9832-7798be1e4f3a tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.229714 Jun 22 10:19:36.895001 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 110/217] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:36 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:36.901002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-285e9762-9153-4905-aa06-5706f6a317a5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:36.902503 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-285e9762-9153-4905-aa06-5706f6a317a5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:36.903636 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-285e9762-9153-4905-aa06-5706f6a317a5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.233279 Jun 22 10:19:36.904731 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 108/218] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:36 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:37.672459 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f5409d09-dba3-4e99-83c3-ae8a2aa7bb42 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:37.673069 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-56144557-6f33-49ce-bb2b-f51f8713d955 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:37.673401 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f5409d09-dba3-4e99-83c3-ae8a2aa7bb42 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:37.673511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-56144557-6f33-49ce-bb2b-f51f8713d955 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:37.680255 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-56144557-6f33-49ce-bb2b-f51f8713d955 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:37.686988 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-56144557-6f33-49ce-bb2b-f51f8713d955 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:37.687117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f5409d09-dba3-4e99-83c3-ae8a2aa7bb42 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:37.687117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f5409d09-dba3-4e99-83c3-ae8a2aa7bb42 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:37.687297 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-56144557-6f33-49ce-bb2b-f51f8713d955 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:37.687297 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-56144557-6f33-49ce-bb2b-f51f8713d955 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:37.687448 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f5409d09-dba3-4e99-83c3-ae8a2aa7bb42 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:37.687448 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f5409d09-dba3-4e99-83c3-ae8a2aa7bb42 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:37.896691 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-56144557-6f33-49ce-bb2b-f51f8713d955 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:37.903303 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f5409d09-dba3-4e99-83c3-ae8a2aa7bb42 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:37.905060 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-56144557-6f33-49ce-bb2b-f51f8713d955 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.236545 Jun 22 10:19:37.905641 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 111/219] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:37 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:37.911033 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-61079553-4c72-4596-9af6-a508cbf26af9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:37.913928 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f5409d09-dba3-4e99-83c3-ae8a2aa7bb42 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.242504 Jun 22 10:19:37.913928 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 109/220] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:37 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:37.914115 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-61079553-4c72-4596-9af6-a508cbf26af9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:37.926940 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a36f5b8a-f751-4901-9829-40235832686a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:37.927461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a36f5b8a-f751-4901-9829-40235832686a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:37.927870 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-61079553-4c72-4596-9af6-a508cbf26af9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:37.928329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-61079553-4c72-4596-9af6-a508cbf26af9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:37.929171 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-61079553-4c72-4596-9af6-a508cbf26af9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:37.929613 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-61079553-4c72-4596-9af6-a508cbf26af9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:37.933448 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a36f5b8a-f751-4901-9829-40235832686a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:37.933887 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a36f5b8a-f751-4901-9829-40235832686a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:37.934646 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a36f5b8a-f751-4901-9829-40235832686a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:37.935081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a36f5b8a-f751-4901-9829-40235832686a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:38.148513 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a36f5b8a-f751-4901-9829-40235832686a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:38.151036 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-61079553-4c72-4596-9af6-a508cbf26af9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:38.159597 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-61079553-4c72-4596-9af6-a508cbf26af9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.252173 Jun 22 10:19:38.160122 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a36f5b8a-f751-4901-9829-40235832686a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:38.160282 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 112/221] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:37 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:38.171326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a36f5b8a-f751-4901-9829-40235832686a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:38.172491 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a36f5b8a-f751-4901-9829-40235832686a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.250086 Jun 22 10:19:38.187537 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 110/222] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:37 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:38.302501 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-84abcd34-4869-44b5-a28d-31c56ad3c186 req-a84f4b07-ccab-4c2c-a21b-95c01af700c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86fa8c96-e39d-47ce-86a0-9d7d7eaf099f", "tag": "9c2ee9e8-f445-4686-bacb-0cbc5c3c71de"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:38.312489 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-84abcd34-4869-44b5-a28d-31c56ad3c186 req-a84f4b07-ccab-4c2c-a21b-95c01af700c2 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:38.312922 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-84abcd34-4869-44b5-a28d-31c56ad3c186 req-a84f4b07-ccab-4c2c-a21b-95c01af700c2 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:38.327116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-84abcd34-4869-44b5-a28d-31c56ad3c186 req-a84f4b07-ccab-4c2c-a21b-95c01af700c2 service nova] Creating event network-changed:9c2ee9e8-f445-4686-bacb-0cbc5c3c71de for instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f on hv-cinder-84327 Jun 22 10:19:38.332245 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-84abcd34-4869-44b5-a28d-31c56ad3c186 req-a84f4b07-ccab-4c2c-a21b-95c01af700c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034278 Jun 22 10:19:38.332883 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 113/223] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:38.921697 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9d6e7b80-6cd2-4198-9d25-dc0d37862772 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:38.922329 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9d6e7b80-6cd2-4198-9d25-dc0d37862772 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:38.928906 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-80e5118e-83b0-4b76-8f99-589e2db1ecef tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:38.929354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d6e7b80-6cd2-4198-9d25-dc0d37862772 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:38.929478 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d6e7b80-6cd2-4198-9d25-dc0d37862772 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:38.929721 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-80e5118e-83b0-4b76-8f99-589e2db1ecef tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:38.930220 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d6e7b80-6cd2-4198-9d25-dc0d37862772 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:38.930648 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d6e7b80-6cd2-4198-9d25-dc0d37862772 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:38.935820 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80e5118e-83b0-4b76-8f99-589e2db1ecef tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:38.936261 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80e5118e-83b0-4b76-8f99-589e2db1ecef tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:38.937027 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80e5118e-83b0-4b76-8f99-589e2db1ecef tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:38.937456 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80e5118e-83b0-4b76-8f99-589e2db1ecef tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:39.126429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9d6e7b80-6cd2-4198-9d25-dc0d37862772 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:39.129374 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-80e5118e-83b0-4b76-8f99-589e2db1ecef tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:39.134014 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9d6e7b80-6cd2-4198-9d25-dc0d37862772 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.216089 Jun 22 10:19:39.134584 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 111/224] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:38 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:39.137206 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-80e5118e-83b0-4b76-8f99-589e2db1ecef tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.212354 Jun 22 10:19:39.137762 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 114/225] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:38 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:39.175460 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5c70cdb3-4b06-49f0-8a10-e6c26ec9a828 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:39.176184 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5c70cdb3-4b06-49f0-8a10-e6c26ec9a828 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:39.182318 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5c70cdb3-4b06-49f0-8a10-e6c26ec9a828 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:39.182769 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5c70cdb3-4b06-49f0-8a10-e6c26ec9a828 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:39.183522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5c70cdb3-4b06-49f0-8a10-e6c26ec9a828 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:39.184043 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5c70cdb3-4b06-49f0-8a10-e6c26ec9a828 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:39.191314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-18a81bfe-0f46-41a8-ad82-5d0788fa6b22 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:39.192040 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-18a81bfe-0f46-41a8-ad82-5d0788fa6b22 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:39.198217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-18a81bfe-0f46-41a8-ad82-5d0788fa6b22 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:39.198744 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-18a81bfe-0f46-41a8-ad82-5d0788fa6b22 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:39.199585 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-18a81bfe-0f46-41a8-ad82-5d0788fa6b22 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:39.200092 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-18a81bfe-0f46-41a8-ad82-5d0788fa6b22 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:39.387074 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5c70cdb3-4b06-49f0-8a10-e6c26ec9a828 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:39.390553 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-18a81bfe-0f46-41a8-ad82-5d0788fa6b22 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:39.396430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5c70cdb3-4b06-49f0-8a10-e6c26ec9a828 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.224679 Jun 22 10:19:39.397048 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 112/226] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:39 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:39.399147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-18a81bfe-0f46-41a8-ad82-5d0788fa6b22 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:39.400654 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-18a81bfe-0f46-41a8-ad82-5d0788fa6b22 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:39.401907 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-18a81bfe-0f46-41a8-ad82-5d0788fa6b22 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.215030 Jun 22 10:19:39.402457 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 115/227] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:39 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:40.150610 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d51e00fa-9b01-4698-ab90-0da64311087d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:40.151212 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d51e00fa-9b01-4698-ab90-0da64311087d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:40.154674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8feaf42f-b759-4e95-87bf-0525db4f01ae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:40.155404 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8feaf42f-b759-4e95-87bf-0525db4f01ae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:40.157382 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d51e00fa-9b01-4698-ab90-0da64311087d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:40.157812 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d51e00fa-9b01-4698-ab90-0da64311087d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:40.158576 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d51e00fa-9b01-4698-ab90-0da64311087d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:40.159006 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d51e00fa-9b01-4698-ab90-0da64311087d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:40.161664 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8feaf42f-b759-4e95-87bf-0525db4f01ae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:40.162133 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8feaf42f-b759-4e95-87bf-0525db4f01ae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:40.162920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8feaf42f-b759-4e95-87bf-0525db4f01ae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:40.163360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8feaf42f-b759-4e95-87bf-0525db4f01ae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:40.362574 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8feaf42f-b759-4e95-87bf-0525db4f01ae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:40.367267 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d51e00fa-9b01-4698-ab90-0da64311087d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:40.370241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8feaf42f-b759-4e95-87bf-0525db4f01ae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.219584 Jun 22 10:19:40.373418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 116/228] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:40 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:40.375661 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d51e00fa-9b01-4698-ab90-0da64311087d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.228936 Jun 22 10:19:40.379064 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 113/229] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:40 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:40.413697 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d763a48c-2faf-4839-aea3-45163c1a97ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:40.414561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d763a48c-2faf-4839-aea3-45163c1a97ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:40.419479 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8535226f-108b-4f16-9cea-a0a572e8c05d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:40.420106 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8535226f-108b-4f16-9cea-a0a572e8c05d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:40.423394 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d763a48c-2faf-4839-aea3-45163c1a97ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:40.423394 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d763a48c-2faf-4839-aea3-45163c1a97ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:40.423394 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d763a48c-2faf-4839-aea3-45163c1a97ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:40.423394 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d763a48c-2faf-4839-aea3-45163c1a97ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:40.426658 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8535226f-108b-4f16-9cea-a0a572e8c05d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:40.427100 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8535226f-108b-4f16-9cea-a0a572e8c05d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:40.427899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8535226f-108b-4f16-9cea-a0a572e8c05d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:40.428277 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8535226f-108b-4f16-9cea-a0a572e8c05d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:40.612897 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d763a48c-2faf-4839-aea3-45163c1a97ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:40.620689 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d763a48c-2faf-4839-aea3-45163c1a97ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.210836 Jun 22 10:19:40.622184 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 117/230] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:40 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:40.638791 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8535226f-108b-4f16-9cea-a0a572e8c05d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:40.647451 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8535226f-108b-4f16-9cea-a0a572e8c05d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:40.649064 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8535226f-108b-4f16-9cea-a0a572e8c05d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:40.650161 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-8535226f-108b-4f16-9cea-a0a572e8c05d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.234802 Jun 22 10:19:40.650721 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 114/231] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:40 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:41.388418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ecc5a19e-724f-49f5-9e04-6059e1c4753a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:41.389136 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ecc5a19e-724f-49f5-9e04-6059e1c4753a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:41.391999 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-07807822-d727-46ba-ab3a-963de69050a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:41.392600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-07807822-d727-46ba-ab3a-963de69050a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:41.395309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ecc5a19e-724f-49f5-9e04-6059e1c4753a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:41.395754 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ecc5a19e-724f-49f5-9e04-6059e1c4753a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:41.396509 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ecc5a19e-724f-49f5-9e04-6059e1c4753a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:41.397038 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ecc5a19e-724f-49f5-9e04-6059e1c4753a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:41.398683 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-07807822-d727-46ba-ab3a-963de69050a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:41.399409 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-07807822-d727-46ba-ab3a-963de69050a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:41.400158 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-07807822-d727-46ba-ab3a-963de69050a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:41.401994 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-07807822-d727-46ba-ab3a-963de69050a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:41.588669 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-07807822-d727-46ba-ab3a-963de69050a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:41.592729 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ecc5a19e-724f-49f5-9e04-6059e1c4753a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:41.598179 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-07807822-d727-46ba-ab3a-963de69050a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.210042 Jun 22 10:19:41.598764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 115/232] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:41 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:41.601653 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ecc5a19e-724f-49f5-9e04-6059e1c4753a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.217285 Jun 22 10:19:41.602390 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 118/233] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:41 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:41.638408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a80905ac-c9cf-4f77-b730-1faefa2fa45b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:41.639024 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a80905ac-c9cf-4f77-b730-1faefa2fa45b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:41.645554 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a80905ac-c9cf-4f77-b730-1faefa2fa45b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:41.645944 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a80905ac-c9cf-4f77-b730-1faefa2fa45b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:41.646710 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a80905ac-c9cf-4f77-b730-1faefa2fa45b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:41.647144 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a80905ac-c9cf-4f77-b730-1faefa2fa45b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:41.667265 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-82a50653-d641-41a5-8c45-43727839ee4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:41.667878 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-82a50653-d641-41a5-8c45-43727839ee4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:41.673809 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82a50653-d641-41a5-8c45-43727839ee4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:41.674257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82a50653-d641-41a5-8c45-43727839ee4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:41.675047 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82a50653-d641-41a5-8c45-43727839ee4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:41.675477 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82a50653-d641-41a5-8c45-43727839ee4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:41.848235 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a80905ac-c9cf-4f77-b730-1faefa2fa45b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:41.852038 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-82a50653-d641-41a5-8c45-43727839ee4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:41.856370 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a80905ac-c9cf-4f77-b730-1faefa2fa45b tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.221941 Jun 22 10:19:41.857184 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 116/234] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:41 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:41.864187 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-82a50653-d641-41a5-8c45-43727839ee4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:41.864187 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-82a50653-d641-41a5-8c45-43727839ee4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:41.864187 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-82a50653-d641-41a5-8c45-43727839ee4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.199702 Jun 22 10:19:41.864447 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 119/235] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:41 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:42.616201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a75cdc39-d3f3-4568-92e1-080a801c2576 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:42.616844 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a75cdc39-d3f3-4568-92e1-080a801c2576 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:42.619293 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-de5b4fb5-3a74-4e75-84df-7f938964fd78 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:42.619904 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-de5b4fb5-3a74-4e75-84df-7f938964fd78 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:42.623004 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a75cdc39-d3f3-4568-92e1-080a801c2576 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:42.623454 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a75cdc39-d3f3-4568-92e1-080a801c2576 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:42.624220 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a75cdc39-d3f3-4568-92e1-080a801c2576 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:42.624662 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a75cdc39-d3f3-4568-92e1-080a801c2576 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:42.626650 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de5b4fb5-3a74-4e75-84df-7f938964fd78 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:42.627124 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de5b4fb5-3a74-4e75-84df-7f938964fd78 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:42.627878 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de5b4fb5-3a74-4e75-84df-7f938964fd78 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:42.628311 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de5b4fb5-3a74-4e75-84df-7f938964fd78 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:42.818166 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a75cdc39-d3f3-4568-92e1-080a801c2576 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:42.821018 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-de5b4fb5-3a74-4e75-84df-7f938964fd78 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:42.826027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a75cdc39-d3f3-4568-92e1-080a801c2576 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.214936 Jun 22 10:19:42.826611 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 117/236] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:42 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:42.828598 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-de5b4fb5-3a74-4e75-84df-7f938964fd78 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.213035 Jun 22 10:19:42.829805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 120/237] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:42 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:42.873605 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d68cbf21-d758-4222-bda6-b2e7a9c4c006 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:42.874217 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d68cbf21-d758-4222-bda6-b2e7a9c4c006 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:42.882192 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bd077eac-a88f-4871-bb77-ed2f3adf03b3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:42.882826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bd077eac-a88f-4871-bb77-ed2f3adf03b3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:42.882933 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d68cbf21-d758-4222-bda6-b2e7a9c4c006 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:42.883279 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d68cbf21-d758-4222-bda6-b2e7a9c4c006 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:42.884060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d68cbf21-d758-4222-bda6-b2e7a9c4c006 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:42.884563 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d68cbf21-d758-4222-bda6-b2e7a9c4c006 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:42.889783 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bd077eac-a88f-4871-bb77-ed2f3adf03b3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:42.890224 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bd077eac-a88f-4871-bb77-ed2f3adf03b3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:42.891000 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bd077eac-a88f-4871-bb77-ed2f3adf03b3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:42.892015 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bd077eac-a88f-4871-bb77-ed2f3adf03b3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:43.109378 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d68cbf21-d758-4222-bda6-b2e7a9c4c006 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:43.118614 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d68cbf21-d758-4222-bda6-b2e7a9c4c006 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.248675 Jun 22 10:19:43.119192 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 118/238] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:42 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:43.162173 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bd077eac-a88f-4871-bb77-ed2f3adf03b3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:43.170724 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bd077eac-a88f-4871-bb77-ed2f3adf03b3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:43.172317 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bd077eac-a88f-4871-bb77-ed2f3adf03b3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:43.173978 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bd077eac-a88f-4871-bb77-ed2f3adf03b3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.295792 Jun 22 10:19:43.174737 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 121/239] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:42 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:43.843273 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-735ab5a2-331e-4c59-ae57-5254b6ee27ac tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:43.843877 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-735ab5a2-331e-4c59-ae57-5254b6ee27ac tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:43.845343 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-197e319d-07a7-411c-a35f-22cb65c57b80 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:43.845947 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-197e319d-07a7-411c-a35f-22cb65c57b80 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:43.850731 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-735ab5a2-331e-4c59-ae57-5254b6ee27ac tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:43.851204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-735ab5a2-331e-4c59-ae57-5254b6ee27ac tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:43.851970 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-735ab5a2-331e-4c59-ae57-5254b6ee27ac tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:43.852177 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-197e319d-07a7-411c-a35f-22cb65c57b80 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:43.852402 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-735ab5a2-331e-4c59-ae57-5254b6ee27ac tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:43.852637 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-197e319d-07a7-411c-a35f-22cb65c57b80 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:43.853434 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-197e319d-07a7-411c-a35f-22cb65c57b80 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:43.853871 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-197e319d-07a7-411c-a35f-22cb65c57b80 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:44.050440 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-735ab5a2-331e-4c59-ae57-5254b6ee27ac tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:44.057849 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-735ab5a2-331e-4c59-ae57-5254b6ee27ac tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.218590 Jun 22 10:19:44.058414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 119/240] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:43 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:44.064232 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-197e319d-07a7-411c-a35f-22cb65c57b80 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:44.076025 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-197e319d-07a7-411c-a35f-22cb65c57b80 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.234957 Jun 22 10:19:44.076576 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 122/241] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:43 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:44.135640 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-34372a75-1ff0-40d7-8aa7-d464e300c809 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:44.136235 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-34372a75-1ff0-40d7-8aa7-d464e300c809 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:44.143422 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-34372a75-1ff0-40d7-8aa7-d464e300c809 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:44.143873 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-34372a75-1ff0-40d7-8aa7-d464e300c809 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:44.144647 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-34372a75-1ff0-40d7-8aa7-d464e300c809 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:44.145295 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-34372a75-1ff0-40d7-8aa7-d464e300c809 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:44.191882 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4e44e1de-2228-49e5-bfcb-347ab2c9c2f9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:44.192487 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4e44e1de-2228-49e5-bfcb-347ab2c9c2f9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:44.198495 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4e44e1de-2228-49e5-bfcb-347ab2c9c2f9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:44.198945 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4e44e1de-2228-49e5-bfcb-347ab2c9c2f9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:44.199707 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4e44e1de-2228-49e5-bfcb-347ab2c9c2f9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:44.200141 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4e44e1de-2228-49e5-bfcb-347ab2c9c2f9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:44.322705 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-34372a75-1ff0-40d7-8aa7-d464e300c809 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:44.331129 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-34372a75-1ff0-40d7-8aa7-d464e300c809 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.199419 Jun 22 10:19:44.331710 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 120/242] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:44 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:44.359567 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4e44e1de-2228-49e5-bfcb-347ab2c9c2f9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:44.367676 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4e44e1de-2228-49e5-bfcb-347ab2c9c2f9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:44.369201 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4e44e1de-2228-49e5-bfcb-347ab2c9c2f9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:44.370309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4e44e1de-2228-49e5-bfcb-347ab2c9c2f9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.182788 Jun 22 10:19:44.370868 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 123/243] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:44 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:45.081670 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-57f6a3b7-3212-40ff-a97e-3a7e7374dd2f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:45.082275 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-57f6a3b7-3212-40ff-a97e-3a7e7374dd2f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:45.088527 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57f6a3b7-3212-40ff-a97e-3a7e7374dd2f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:45.089005 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57f6a3b7-3212-40ff-a97e-3a7e7374dd2f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:45.089775 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57f6a3b7-3212-40ff-a97e-3a7e7374dd2f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:45.090199 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57f6a3b7-3212-40ff-a97e-3a7e7374dd2f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:45.099446 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-73b36b0e-be01-4251-a474-13171884720c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:45.100086 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-73b36b0e-be01-4251-a474-13171884720c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:45.106145 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-73b36b0e-be01-4251-a474-13171884720c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:45.106586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-73b36b0e-be01-4251-a474-13171884720c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:45.107364 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-73b36b0e-be01-4251-a474-13171884720c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:45.107800 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-73b36b0e-be01-4251-a474-13171884720c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:45.290306 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-57f6a3b7-3212-40ff-a97e-3a7e7374dd2f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:45.294106 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-73b36b0e-be01-4251-a474-13171884720c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:45.298617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-57f6a3b7-3212-40ff-a97e-3a7e7374dd2f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.220411 Jun 22 10:19:45.299292 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 121/244] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:45 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:45.302043 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-73b36b0e-be01-4251-a474-13171884720c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.212726 Jun 22 10:19:45.302605 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 124/245] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:45 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:45.348034 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ce77d096-3999-4a64-af5c-31a23ccdc2c3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:45.348634 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ce77d096-3999-4a64-af5c-31a23ccdc2c3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:45.354643 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ce77d096-3999-4a64-af5c-31a23ccdc2c3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:45.355085 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ce77d096-3999-4a64-af5c-31a23ccdc2c3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:45.355837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ce77d096-3999-4a64-af5c-31a23ccdc2c3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:45.356261 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ce77d096-3999-4a64-af5c-31a23ccdc2c3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:45.387292 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8740a661-d07e-4a19-8656-13a33e0530f8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:45.388189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8740a661-d07e-4a19-8656-13a33e0530f8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:45.394716 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8740a661-d07e-4a19-8656-13a33e0530f8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:45.395152 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8740a661-d07e-4a19-8656-13a33e0530f8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:45.395925 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8740a661-d07e-4a19-8656-13a33e0530f8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:45.396333 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8740a661-d07e-4a19-8656-13a33e0530f8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:45.532770 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ce77d096-3999-4a64-af5c-31a23ccdc2c3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:45.540377 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ce77d096-3999-4a64-af5c-31a23ccdc2c3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.196653 Jun 22 10:19:45.541054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 122/246] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:45 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:45.560120 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8740a661-d07e-4a19-8656-13a33e0530f8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:45.568580 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8740a661-d07e-4a19-8656-13a33e0530f8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:45.570092 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8740a661-d07e-4a19-8656-13a33e0530f8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:45.571188 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8740a661-d07e-4a19-8656-13a33e0530f8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.187683 Jun 22 10:19:45.571724 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 125/247] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:45 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:46.315338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bfbcbf9d-9a31-4f44-9e03-69cc30ad7159 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:46.315945 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bfbcbf9d-9a31-4f44-9e03-69cc30ad7159 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:46.319304 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ac11ba7b-5502-4886-8769-5796b474721a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:46.319984 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ac11ba7b-5502-4886-8769-5796b474721a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:46.322261 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bfbcbf9d-9a31-4f44-9e03-69cc30ad7159 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:46.322715 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bfbcbf9d-9a31-4f44-9e03-69cc30ad7159 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:46.324202 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bfbcbf9d-9a31-4f44-9e03-69cc30ad7159 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:46.324202 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bfbcbf9d-9a31-4f44-9e03-69cc30ad7159 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:46.326131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ac11ba7b-5502-4886-8769-5796b474721a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:46.326767 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ac11ba7b-5502-4886-8769-5796b474721a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:46.327577 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ac11ba7b-5502-4886-8769-5796b474721a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:46.328013 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ac11ba7b-5502-4886-8769-5796b474721a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:46.563268 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ac11ba7b-5502-4886-8769-5796b474721a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:46.567419 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bfbcbf9d-9a31-4f44-9e03-69cc30ad7159 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:46.571417 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ac11ba7b-5502-4886-8769-5796b474721a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.256053 Jun 22 10:19:46.576273 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 126/248] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:46 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:46.576741 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0ae05f1d-1f2a-4182-961a-7addd50a6af7 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:46.577176 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0ae05f1d-1f2a-4182-961a-7addd50a6af7 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:46.580019 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bfbcbf9d-9a31-4f44-9e03-69cc30ad7159 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.269163 Jun 22 10:19:46.581122 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 123/249] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:46 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:46.583155 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0ae05f1d-1f2a-4182-961a-7addd50a6af7 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:46.583603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0ae05f1d-1f2a-4182-961a-7addd50a6af7 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:46.584378 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0ae05f1d-1f2a-4182-961a-7addd50a6af7 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:46.584812 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0ae05f1d-1f2a-4182-961a-7addd50a6af7 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:46.590383 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:46.590528 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7b5fcddf-292c-449d-bbc9-baba45bf5b2c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:46.590528 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7b5fcddf-292c-449d-bbc9-baba45bf5b2c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:46.596994 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7b5fcddf-292c-449d-bbc9-baba45bf5b2c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:46.597469 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7b5fcddf-292c-449d-bbc9-baba45bf5b2c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:46.598527 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7b5fcddf-292c-449d-bbc9-baba45bf5b2c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:46.598970 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7b5fcddf-292c-449d-bbc9-baba45bf5b2c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.112444 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0ae05f1d-1f2a-4182-961a-7addd50a6af7 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:47.120445 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0ae05f1d-1f2a-4182-961a-7addd50a6af7 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.547431 Jun 22 10:19:47.121449 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 127/250] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:46 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:47.134347 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-513f2c0a-0f49-4aa3-93d0-6b735454d2af req-48461d4d-a4b1-4d3d-96d3-8b9684ce39e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8701ce7d-38d6-4383-9491-e2d4740a2f5f", "name": "network-vif-plugged", "status": "completed", "tag": "39ba7490-4bda-4946-a369-308acdb5baa3"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:47.143108 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7b5fcddf-292c-449d-bbc9-baba45bf5b2c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:47.146754 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-513f2c0a-0f49-4aa3-93d0-6b735454d2af req-48461d4d-a4b1-4d3d-96d3-8b9684ce39e1 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.146754 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-513f2c0a-0f49-4aa3-93d0-6b735454d2af req-48461d4d-a4b1-4d3d-96d3-8b9684ce39e1 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.152650 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7b5fcddf-292c-449d-bbc9-baba45bf5b2c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:47.154356 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7b5fcddf-292c-449d-bbc9-baba45bf5b2c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:47.155585 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7b5fcddf-292c-449d-bbc9-baba45bf5b2c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.569931 Jun 22 10:19:47.156665 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 124/251] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:46 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:47.158145 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-513f2c0a-0f49-4aa3-93d0-6b735454d2af req-48461d4d-a4b1-4d3d-96d3-8b9684ce39e1 service nova] Creating event network-vif-plugged:39ba7490-4bda-4946-a369-308acdb5baa3 for instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f on hv-cinder-84327 Jun 22 10:19:47.163099 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-513f2c0a-0f49-4aa3-93d0-6b735454d2af req-48461d4d-a4b1-4d3d-96d3-8b9684ce39e1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032967 Jun 22 10:19:47.163953 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 128/252] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:47.588277 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-decb4803-d453-4536-a10e-121ef7a35c2a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:47.588914 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-decb4803-d453-4536-a10e-121ef7a35c2a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:47.595645 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-decb4803-d453-4536-a10e-121ef7a35c2a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.596092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-decb4803-d453-4536-a10e-121ef7a35c2a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.596887 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-decb4803-d453-4536-a10e-121ef7a35c2a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.597329 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-decb4803-d453-4536-a10e-121ef7a35c2a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.598179 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f241193d-f306-428c-b371-431c77ad4f27 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:47.598906 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f241193d-f306-428c-b371-431c77ad4f27 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:47.601537 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:47.605518 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f241193d-f306-428c-b371-431c77ad4f27 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.605876 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f241193d-f306-428c-b371-431c77ad4f27 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.607073 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f241193d-f306-428c-b371-431c77ad4f27 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.607073 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f241193d-f306-428c-b371-431c77ad4f27 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.821386 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-decb4803-d453-4536-a10e-121ef7a35c2a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:47.829675 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f241193d-f306-428c-b371-431c77ad4f27 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:47.835549 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-decb4803-d453-4536-a10e-121ef7a35c2a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.250822 Jun 22 10:19:47.836362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 125/253] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:47 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:47.841831 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f241193d-f306-428c-b371-431c77ad4f27 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.248369 Jun 22 10:19:47.841831 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 129/254] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:47 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:48.138515 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-65fa84e1-42d5-4c43-9930-fc4c321c2a29 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:48.139123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-65fa84e1-42d5-4c43-9930-fc4c321c2a29 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:48.145983 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-65fa84e1-42d5-4c43-9930-fc4c321c2a29 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.146441 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-65fa84e1-42d5-4c43-9930-fc4c321c2a29 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.147211 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-65fa84e1-42d5-4c43-9930-fc4c321c2a29 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.147646 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-65fa84e1-42d5-4c43-9930-fc4c321c2a29 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.174609 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bdc719c7-982d-456a-b188-d3baceac7bfe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:48.175213 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bdc719c7-982d-456a-b188-d3baceac7bfe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:48.182457 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bdc719c7-982d-456a-b188-d3baceac7bfe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.182894 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bdc719c7-982d-456a-b188-d3baceac7bfe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.183650 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bdc719c7-982d-456a-b188-d3baceac7bfe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.184177 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bdc719c7-982d-456a-b188-d3baceac7bfe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.402591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bdc719c7-982d-456a-b188-d3baceac7bfe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:48.407293 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-65fa84e1-42d5-4c43-9930-fc4c321c2a29 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:48.412481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bdc719c7-982d-456a-b188-d3baceac7bfe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:48.415167 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bdc719c7-982d-456a-b188-d3baceac7bfe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:48.416014 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-65fa84e1-42d5-4c43-9930-fc4c321c2a29 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.281613 Jun 22 10:19:48.416454 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bdc719c7-982d-456a-b188-d3baceac7bfe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.246983 Jun 22 10:19:48.420922 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 126/255] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:48 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:48.421320 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 130/256] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:48 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:48.859010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-225cbe69-d62a-4090-88cb-146f80425b1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:48.860301 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-225cbe69-d62a-4090-88cb-146f80425b1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:48.861399 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-694529d8-428d-4246-af1c-8ced9ddee923 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:48.862008 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-694529d8-428d-4246-af1c-8ced9ddee923 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:48.871349 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-225cbe69-d62a-4090-88cb-146f80425b1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.872246 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-225cbe69-d62a-4090-88cb-146f80425b1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.874310 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-225cbe69-d62a-4090-88cb-146f80425b1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.875473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-694529d8-428d-4246-af1c-8ced9ddee923 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.875737 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-225cbe69-d62a-4090-88cb-146f80425b1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.876409 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-694529d8-428d-4246-af1c-8ced9ddee923 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.883478 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-694529d8-428d-4246-af1c-8ced9ddee923 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.883478 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-694529d8-428d-4246-af1c-8ced9ddee923 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:49.128369 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-694529d8-428d-4246-af1c-8ced9ddee923 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:49.131887 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-225cbe69-d62a-4090-88cb-146f80425b1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:49.136859 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-694529d8-428d-4246-af1c-8ced9ddee923 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1322 microversion: 2.1 time: 0.279217 Jun 22 10:19:49.137309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 131/257] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:48 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:49.148631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-225cbe69-d62a-4090-88cb-146f80425b1c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.294946 Jun 22 10:19:49.149253 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 127/258] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:48 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:49.433978 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-37d379e1-204e-4b10-86f9-d2f1c78fcb88 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:49.434506 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-37d379e1-204e-4b10-86f9-d2f1c78fcb88 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:49.436475 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-abbf4817-e68c-417f-901c-528d836bad54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:49.437119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-abbf4817-e68c-417f-901c-528d836bad54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:49.440627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-37d379e1-204e-4b10-86f9-d2f1c78fcb88 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:49.441188 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-37d379e1-204e-4b10-86f9-d2f1c78fcb88 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:49.442023 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-37d379e1-204e-4b10-86f9-d2f1c78fcb88 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:49.442465 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-37d379e1-204e-4b10-86f9-d2f1c78fcb88 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:49.443049 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-abbf4817-e68c-417f-901c-528d836bad54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:49.443498 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-abbf4817-e68c-417f-901c-528d836bad54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:49.444259 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-abbf4817-e68c-417f-901c-528d836bad54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:49.444692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-abbf4817-e68c-417f-901c-528d836bad54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:49.702959 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-37d379e1-204e-4b10-86f9-d2f1c78fcb88 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:49.711735 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-37d379e1-204e-4b10-86f9-d2f1c78fcb88 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.281816 Jun 22 10:19:49.712530 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 132/259] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:49 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:49.735670 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-abbf4817-e68c-417f-901c-528d836bad54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:49.748666 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-abbf4817-e68c-417f-901c-528d836bad54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:49.748666 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-abbf4817-e68c-417f-901c-528d836bad54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:49.748666 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-abbf4817-e68c-417f-901c-528d836bad54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.314369 Jun 22 10:19:49.748983 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 128/260] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:49 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:50.153437 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6c161a41-52bf-49f7-82d9-43f9423caae1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:50.154032 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6c161a41-52bf-49f7-82d9-43f9423caae1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:50.160129 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6c161a41-52bf-49f7-82d9-43f9423caae1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.160595 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6c161a41-52bf-49f7-82d9-43f9423caae1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.161364 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6c161a41-52bf-49f7-82d9-43f9423caae1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.161799 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6c161a41-52bf-49f7-82d9-43f9423caae1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.164776 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1d110d5a-eb55-44cd-98b4-97d2b76a8327 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:50.165401 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1d110d5a-eb55-44cd-98b4-97d2b76a8327 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:50.171322 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1d110d5a-eb55-44cd-98b4-97d2b76a8327 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.171765 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1d110d5a-eb55-44cd-98b4-97d2b76a8327 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.172521 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1d110d5a-eb55-44cd-98b4-97d2b76a8327 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.172978 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1d110d5a-eb55-44cd-98b4-97d2b76a8327 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.379999 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6c161a41-52bf-49f7-82d9-43f9423caae1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:50.382150 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1d110d5a-eb55-44cd-98b4-97d2b76a8327 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:50.398150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6c161a41-52bf-49f7-82d9-43f9423caae1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1516 microversion: 2.1 time: 0.239912 Jun 22 10:19:50.398150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 133/261] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:50 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1516 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:50.398293 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1d110d5a-eb55-44cd-98b4-97d2b76a8327 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.232556 Jun 22 10:19:50.398293 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 129/262] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:50 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:50.406833 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3d0c4a7e-9996-48ac-871f-4f8064d445ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:50.407882 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3d0c4a7e-9996-48ac-871f-4f8064d445ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:50.414084 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3d0c4a7e-9996-48ac-871f-4f8064d445ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.414530 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3d0c4a7e-9996-48ac-871f-4f8064d445ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.419926 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3d0c4a7e-9996-48ac-871f-4f8064d445ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.419926 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3d0c4a7e-9996-48ac-871f-4f8064d445ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.477880 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-3d0c4a7e-9996-48ac-871f-4f8064d445ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lazy-loading 'flavor' on Instance uuid c2acd1a7-4078-4955-ab65-12d905064011 {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:19:50.729561 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c8158d24-2f92-469d-9096-9e7324715ad3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:50.730169 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c8158d24-2f92-469d-9096-9e7324715ad3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:50.737040 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c8158d24-2f92-469d-9096-9e7324715ad3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.737871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c8158d24-2f92-469d-9096-9e7324715ad3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.739078 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c8158d24-2f92-469d-9096-9e7324715ad3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.739584 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c8158d24-2f92-469d-9096-9e7324715ad3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.822589 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3d0c4a7e-9996-48ac-871f-4f8064d445ee tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "POST /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011/action" status: 200 len: 32 microversion: 2.1 time: 0.418755 Jun 22 10:19:50.823240 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 134/263] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:19:50 2022] POST /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011/action => generated 32 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:19:50.831029 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b8107a37-a3ea-4fad-8f50-b669de4166b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:50.831731 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b8107a37-a3ea-4fad-8f50-b669de4166b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:50.839571 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b8107a37-a3ea-4fad-8f50-b669de4166b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.840205 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b8107a37-a3ea-4fad-8f50-b669de4166b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.841229 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b8107a37-a3ea-4fad-8f50-b669de4166b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.842309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b8107a37-a3ea-4fad-8f50-b669de4166b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.903871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c8158d24-2f92-469d-9096-9e7324715ad3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:50.923330 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c8158d24-2f92-469d-9096-9e7324715ad3 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.197724 Jun 22 10:19:50.923931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 130/264] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:50 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:50.946052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a88fa693-7045-41be-b83e-72627521168f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:50.946052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a88fa693-7045-41be-b83e-72627521168f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:50.951699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a88fa693-7045-41be-b83e-72627521168f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.953490 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a88fa693-7045-41be-b83e-72627521168f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.955511 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a88fa693-7045-41be-b83e-72627521168f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.957344 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a88fa693-7045-41be-b83e-72627521168f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:51.131022 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b8107a37-a3ea-4fad-8f50-b669de4166b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:51.139484 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b8107a37-a3ea-4fad-8f50-b669de4166b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:51.141184 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b8107a37-a3ea-4fad-8f50-b669de4166b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:51.142875 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b8107a37-a3ea-4fad-8f50-b669de4166b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.317888 Jun 22 10:19:51.143436 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 135/265] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:50 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:51.161122 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a88fa693-7045-41be-b83e-72627521168f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:51.168704 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a88fa693-7045-41be-b83e-72627521168f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.238774 Jun 22 10:19:51.169323 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 131/266] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:50 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:51.409840 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-cb69af4d-8f3c-4497-b624-6fd7dc842263 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:51.410448 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-cb69af4d-8f3c-4497-b624-6fd7dc842263 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:51.416576 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cb69af4d-8f3c-4497-b624-6fd7dc842263 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:51.417058 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cb69af4d-8f3c-4497-b624-6fd7dc842263 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:51.417874 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cb69af4d-8f3c-4497-b624-6fd7dc842263 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:51.418305 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cb69af4d-8f3c-4497-b624-6fd7dc842263 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:51.546143 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-cb69af4d-8f3c-4497-b624-6fd7dc842263 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:51.554175 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-cb69af4d-8f3c-4497-b624-6fd7dc842263 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.148232 Jun 22 10:19:51.554786 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 136/267] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:51 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:51.940105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6e77bed8-1d2f-40c5-9cf8-09f45779d9ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:51.940871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6e77bed8-1d2f-40c5-9cf8-09f45779d9ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:51.946970 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6e77bed8-1d2f-40c5-9cf8-09f45779d9ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:51.947409 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6e77bed8-1d2f-40c5-9cf8-09f45779d9ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:51.948166 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6e77bed8-1d2f-40c5-9cf8-09f45779d9ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:51.948596 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6e77bed8-1d2f-40c5-9cf8-09f45779d9ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.102756 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6e77bed8-1d2f-40c5-9cf8-09f45779d9ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:52.108454 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6e77bed8-1d2f-40c5-9cf8-09f45779d9ed tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.172691 Jun 22 10:19:52.109069 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 132/268] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:51 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:52.160728 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b595d949-705a-4823-8426-4d876cded04b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:52.161356 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b595d949-705a-4823-8426-4d876cded04b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:52.167787 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b595d949-705a-4823-8426-4d876cded04b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.168233 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b595d949-705a-4823-8426-4d876cded04b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.169027 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b595d949-705a-4823-8426-4d876cded04b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.169466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b595d949-705a-4823-8426-4d876cded04b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.185473 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-aecda135-ca96-4ea5-a01a-395a731707f9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:52.186102 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-aecda135-ca96-4ea5-a01a-395a731707f9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:52.192631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-aecda135-ca96-4ea5-a01a-395a731707f9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.193101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-aecda135-ca96-4ea5-a01a-395a731707f9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.193863 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-aecda135-ca96-4ea5-a01a-395a731707f9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.194286 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-aecda135-ca96-4ea5-a01a-395a731707f9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.381090 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b595d949-705a-4823-8426-4d876cded04b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:52.388703 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-aecda135-ca96-4ea5-a01a-395a731707f9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:52.389544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b595d949-705a-4823-8426-4d876cded04b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:52.391083 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b595d949-705a-4823-8426-4d876cded04b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:52.392195 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b595d949-705a-4823-8426-4d876cded04b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.235475 Jun 22 10:19:52.392755 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 137/269] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:52 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:52.397340 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-aecda135-ca96-4ea5-a01a-395a731707f9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.215715 Jun 22 10:19:52.398069 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 133/270] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:52 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:52.571199 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d5080ff0-4ddb-41ba-9a5b-2122f2f5ab24 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:52.571701 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d5080ff0-4ddb-41ba-9a5b-2122f2f5ab24 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:52.577897 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d5080ff0-4ddb-41ba-9a5b-2122f2f5ab24 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.578344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d5080ff0-4ddb-41ba-9a5b-2122f2f5ab24 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.579680 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d5080ff0-4ddb-41ba-9a5b-2122f2f5ab24 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.580114 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d5080ff0-4ddb-41ba-9a5b-2122f2f5ab24 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.715767 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d5080ff0-4ddb-41ba-9a5b-2122f2f5ab24 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:52.723202 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d5080ff0-4ddb-41ba-9a5b-2122f2f5ab24 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.155926 Jun 22 10:19:52.723765 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 138/271] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:52 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:53.124931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4d72fe20-c8a9-4ec2-916e-5e256966a1fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:53.125808 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4d72fe20-c8a9-4ec2-916e-5e256966a1fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:53.131056 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:53.132514 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d72fe20-c8a9-4ec2-916e-5e256966a1fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.132991 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d72fe20-c8a9-4ec2-916e-5e256966a1fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.133772 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d72fe20-c8a9-4ec2-916e-5e256966a1fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.134217 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d72fe20-c8a9-4ec2-916e-5e256966a1fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.267237 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4d72fe20-c8a9-4ec2-916e-5e256966a1fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:53.274931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4d72fe20-c8a9-4ec2-916e-5e256966a1fc tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.153683 Jun 22 10:19:53.275502 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 134/272] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:53 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:53.410827 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c6fe3fde-8992-4b35-b265-7e083fbddfa4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:53.411584 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c6fe3fde-8992-4b35-b265-7e083fbddfa4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:53.413991 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6c2f7bf9-b89e-44a3-bd9e-c1f4109f21bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:53.414653 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6c2f7bf9-b89e-44a3-bd9e-c1f4109f21bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:53.417898 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c6fe3fde-8992-4b35-b265-7e083fbddfa4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.418331 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c6fe3fde-8992-4b35-b265-7e083fbddfa4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.419091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c6fe3fde-8992-4b35-b265-7e083fbddfa4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.419522 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c6fe3fde-8992-4b35-b265-7e083fbddfa4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.420398 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c2f7bf9-b89e-44a3-bd9e-c1f4109f21bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.420872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c2f7bf9-b89e-44a3-bd9e-c1f4109f21bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.421631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c2f7bf9-b89e-44a3-bd9e-c1f4109f21bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.422061 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c2f7bf9-b89e-44a3-bd9e-c1f4109f21bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.615876 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c6fe3fde-8992-4b35-b265-7e083fbddfa4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:53.623768 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c6fe3fde-8992-4b35-b265-7e083fbddfa4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:53.625158 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6c2f7bf9-b89e-44a3-bd9e-c1f4109f21bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:53.625289 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c6fe3fde-8992-4b35-b265-7e083fbddfa4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:53.626528 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c6fe3fde-8992-4b35-b265-7e083fbddfa4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.220121 Jun 22 10:19:53.627079 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 139/273] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:53 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:53.640297 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6c2f7bf9-b89e-44a3-bd9e-c1f4109f21bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.228073 Jun 22 10:19:53.640297 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 135/274] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:53 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:53.739707 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bbd01d35-6f86-49f5-8b31-86bc6ede971a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:53.740322 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bbd01d35-6f86-49f5-8b31-86bc6ede971a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:53.746461 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bbd01d35-6f86-49f5-8b31-86bc6ede971a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.746929 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bbd01d35-6f86-49f5-8b31-86bc6ede971a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.747685 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bbd01d35-6f86-49f5-8b31-86bc6ede971a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.748119 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bbd01d35-6f86-49f5-8b31-86bc6ede971a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.881469 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bbd01d35-6f86-49f5-8b31-86bc6ede971a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:53.889101 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bbd01d35-6f86-49f5-8b31-86bc6ede971a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.153223 Jun 22 10:19:53.889888 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 140/275] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:53 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:54.291524 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8124257d-ec36-471a-8429-cc986b0ded8c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:54.292134 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8124257d-ec36-471a-8429-cc986b0ded8c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:54.298755 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8124257d-ec36-471a-8429-cc986b0ded8c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:54.299202 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8124257d-ec36-471a-8429-cc986b0ded8c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:54.299968 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8124257d-ec36-471a-8429-cc986b0ded8c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:54.306791 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8124257d-ec36-471a-8429-cc986b0ded8c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:54.434297 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8124257d-ec36-471a-8429-cc986b0ded8c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:54.442211 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-8124257d-ec36-471a-8429-cc986b0ded8c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.154588 Jun 22 10:19:54.442767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 136/276] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:54 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:54.643860 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bf8a0430-b679-4993-94bf-bf26aa694c3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:54.644468 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bf8a0430-b679-4993-94bf-bf26aa694c3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:54.650834 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bf8a0430-b679-4993-94bf-bf26aa694c3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:54.657966 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bf8a0430-b679-4993-94bf-bf26aa694c3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:54.657966 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bf8a0430-b679-4993-94bf-bf26aa694c3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:54.657966 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bf8a0430-b679-4993-94bf-bf26aa694c3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:54.658298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ca9f2140-39c3-4f14-ae39-616b6d8f6817 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:54.658298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ca9f2140-39c3-4f14-ae39-616b6d8f6817 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:54.662208 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ca9f2140-39c3-4f14-ae39-616b6d8f6817 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:54.662662 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ca9f2140-39c3-4f14-ae39-616b6d8f6817 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:54.663461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ca9f2140-39c3-4f14-ae39-616b6d8f6817 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:54.663902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ca9f2140-39c3-4f14-ae39-616b6d8f6817 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:54.843480 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bf8a0430-b679-4993-94bf-bf26aa694c3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:54.847935 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ca9f2140-39c3-4f14-ae39-616b6d8f6817 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:54.852402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bf8a0430-b679-4993-94bf-bf26aa694c3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:54.853955 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bf8a0430-b679-4993-94bf-bf26aa694c3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:54.855050 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bf8a0430-b679-4993-94bf-bf26aa694c3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.215166 Jun 22 10:19:54.855367 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ca9f2140-39c3-4f14-ae39-616b6d8f6817 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.203919 Jun 22 10:19:54.855608 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 141/277] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:54 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:54.855930 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 137/278] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:54 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:54.907025 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-651b219a-2b8d-48a9-8fee-7f4e331e2ebe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:54.907669 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-651b219a-2b8d-48a9-8fee-7f4e331e2ebe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:54.913627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-651b219a-2b8d-48a9-8fee-7f4e331e2ebe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:54.914069 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-651b219a-2b8d-48a9-8fee-7f4e331e2ebe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:54.914822 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-651b219a-2b8d-48a9-8fee-7f4e331e2ebe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:54.915249 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-651b219a-2b8d-48a9-8fee-7f4e331e2ebe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:54.933988 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:55.056120 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-651b219a-2b8d-48a9-8fee-7f4e331e2ebe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:55.063644 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-651b219a-2b8d-48a9-8fee-7f4e331e2ebe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.160844 Jun 22 10:19:55.064309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 142/279] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:54 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:55.459406 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0b6428bd-311f-4027-af74-16157be217a1 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:55.460012 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0b6428bd-311f-4027-af74-16157be217a1 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:55.466260 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b6428bd-311f-4027-af74-16157be217a1 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:55.466622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b6428bd-311f-4027-af74-16157be217a1 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:55.467377 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b6428bd-311f-4027-af74-16157be217a1 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:55.467810 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b6428bd-311f-4027-af74-16157be217a1 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:55.597046 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0b6428bd-311f-4027-af74-16157be217a1 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:55.604605 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0b6428bd-311f-4027-af74-16157be217a1 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.149001 Jun 22 10:19:55.605268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 138/280] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:55 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:55.872281 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2775b89c-f697-4ce7-83aa-8843c2a859b6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:55.872945 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2775b89c-f697-4ce7-83aa-8843c2a859b6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:55.873442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4b57908b-110d-482f-b3fa-ea37f3907ba4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:55.874052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4b57908b-110d-482f-b3fa-ea37f3907ba4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:55.879918 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2775b89c-f697-4ce7-83aa-8843c2a859b6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:55.880368 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2775b89c-f697-4ce7-83aa-8843c2a859b6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:55.880843 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4b57908b-110d-482f-b3fa-ea37f3907ba4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:55.881168 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2775b89c-f697-4ce7-83aa-8843c2a859b6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:55.881605 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2775b89c-f697-4ce7-83aa-8843c2a859b6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:55.881834 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4b57908b-110d-482f-b3fa-ea37f3907ba4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:55.882614 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4b57908b-110d-482f-b3fa-ea37f3907ba4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:55.883051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4b57908b-110d-482f-b3fa-ea37f3907ba4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.088904 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2775b89c-f697-4ce7-83aa-8843c2a859b6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:56.089346 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4b57908b-110d-482f-b3fa-ea37f3907ba4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:56.099451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2775b89c-f697-4ce7-83aa-8843c2a859b6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.231700 Jun 22 10:19:56.100873 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4b57908b-110d-482f-b3fa-ea37f3907ba4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:56.102915 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4b57908b-110d-482f-b3fa-ea37f3907ba4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:56.103275 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 143/281] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:55 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:56.104527 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4b57908b-110d-482f-b3fa-ea37f3907ba4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.235110 Jun 22 10:19:56.106872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 139/282] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:55 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:56.115099 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0222fd8c-ee00-4231-bc42-8ee51e3b24f1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:56.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0222fd8c-ee00-4231-bc42-8ee51e3b24f1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:56.118116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:56.123821 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0222fd8c-ee00-4231-bc42-8ee51e3b24f1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.124331 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0222fd8c-ee00-4231-bc42-8ee51e3b24f1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.125116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0222fd8c-ee00-4231-bc42-8ee51e3b24f1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.130283 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0222fd8c-ee00-4231-bc42-8ee51e3b24f1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.283847 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0222fd8c-ee00-4231-bc42-8ee51e3b24f1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:56.295079 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0222fd8c-ee00-4231-bc42-8ee51e3b24f1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.188910 Jun 22 10:19:56.295079 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 144/283] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:56 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:56.621618 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-32cf5d5c-4e77-4325-b459-beaed50d5a82 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:56.622223 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-32cf5d5c-4e77-4325-b459-beaed50d5a82 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:56.628967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-32cf5d5c-4e77-4325-b459-beaed50d5a82 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.629458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-32cf5d5c-4e77-4325-b459-beaed50d5a82 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.630188 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-32cf5d5c-4e77-4325-b459-beaed50d5a82 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.630627 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-32cf5d5c-4e77-4325-b459-beaed50d5a82 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.768790 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-32cf5d5c-4e77-4325-b459-beaed50d5a82 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:56.776718 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-32cf5d5c-4e77-4325-b459-beaed50d5a82 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1315 microversion: 2.1 time: 0.158836 Jun 22 10:19:56.777332 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 140/284] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:56 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:57.116583 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-896199f5-a20e-4e9d-a51e-c2af902c0f60 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:57.117340 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-896199f5-a20e-4e9d-a51e-c2af902c0f60 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:57.123650 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-896199f5-a20e-4e9d-a51e-c2af902c0f60 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.124308 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-896199f5-a20e-4e9d-a51e-c2af902c0f60 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.126545 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-896199f5-a20e-4e9d-a51e-c2af902c0f60 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.126545 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-896199f5-a20e-4e9d-a51e-c2af902c0f60 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.126906 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ddf172be-9668-4fcf-bf83-94e2fca7f138 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:57.127519 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ddf172be-9668-4fcf-bf83-94e2fca7f138 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:57.133911 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ddf172be-9668-4fcf-bf83-94e2fca7f138 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.134564 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ddf172be-9668-4fcf-bf83-94e2fca7f138 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.135680 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ddf172be-9668-4fcf-bf83-94e2fca7f138 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.136323 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ddf172be-9668-4fcf-bf83-94e2fca7f138 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.363152 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-896199f5-a20e-4e9d-a51e-c2af902c0f60 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:57.365582 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ddf172be-9668-4fcf-bf83-94e2fca7f138 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:57.369830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:57.372184 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-896199f5-a20e-4e9d-a51e-c2af902c0f60 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.259568 Jun 22 10:19:57.377454 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 145/285] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:57 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:57.377596 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ddf172be-9668-4fcf-bf83-94e2fca7f138 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:57.377596 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ddf172be-9668-4fcf-bf83-94e2fca7f138 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:57.378282 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ddf172be-9668-4fcf-bf83-94e2fca7f138 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.255889 Jun 22 10:19:57.379107 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 141/286] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:57 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:57.381820 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-13e0c5c7-6c24-4830-95b7-2c8b80161282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:57.382425 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-13e0c5c7-6c24-4830-95b7-2c8b80161282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:57.389110 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-13e0c5c7-6c24-4830-95b7-2c8b80161282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.389554 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-13e0c5c7-6c24-4830-95b7-2c8b80161282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.390310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-13e0c5c7-6c24-4830-95b7-2c8b80161282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.390738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-13e0c5c7-6c24-4830-95b7-2c8b80161282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.533702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-13e0c5c7-6c24-4830-95b7-2c8b80161282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:57.541406 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-13e0c5c7-6c24-4830-95b7-2c8b80161282 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.166805 Jun 22 10:19:57.541984 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 146/287] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:57 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:57.793661 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4f7671d6-d989-4752-95fa-69c30ca15a37 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:57.794280 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4f7671d6-d989-4752-95fa-69c30ca15a37 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:57.800523 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f7671d6-d989-4752-95fa-69c30ca15a37 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.801006 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f7671d6-d989-4752-95fa-69c30ca15a37 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.801931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f7671d6-d989-4752-95fa-69c30ca15a37 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.802358 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f7671d6-d989-4752-95fa-69c30ca15a37 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.944719 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4f7671d6-d989-4752-95fa-69c30ca15a37 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:57.952651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4f7671d6-d989-4752-95fa-69c30ca15a37 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1503 microversion: 2.1 time: 0.163133 Jun 22 10:19:57.953419 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 142/288] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:57 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:58.389972 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4262493d-f6eb-43ca-a45b-ab90c7d3de25 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:58.390956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4262493d-f6eb-43ca-a45b-ab90c7d3de25 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:58.396044 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-57b42356-9881-4cdb-b2e8-295250dc11f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:58.396953 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-57b42356-9881-4cdb-b2e8-295250dc11f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:58.398479 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4262493d-f6eb-43ca-a45b-ab90c7d3de25 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:58.398931 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4262493d-f6eb-43ca-a45b-ab90c7d3de25 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:58.399704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4262493d-f6eb-43ca-a45b-ab90c7d3de25 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:58.400194 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4262493d-f6eb-43ca-a45b-ab90c7d3de25 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:58.408273 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57b42356-9881-4cdb-b2e8-295250dc11f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:58.408454 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57b42356-9881-4cdb-b2e8-295250dc11f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:58.409201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57b42356-9881-4cdb-b2e8-295250dc11f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:58.409929 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57b42356-9881-4cdb-b2e8-295250dc11f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:58.664473 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-57b42356-9881-4cdb-b2e8-295250dc11f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:58.669766 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4262493d-f6eb-43ca-a45b-ab90c7d3de25 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:58.671520 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-57b42356-9881-4cdb-b2e8-295250dc11f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:58.674200 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-57b42356-9881-4cdb-b2e8-295250dc11f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:58.675314 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-57b42356-9881-4cdb-b2e8-295250dc11f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.283676 Jun 22 10:19:58.676317 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 143/289] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:58 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:58.678116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4262493d-f6eb-43ca-a45b-ab90c7d3de25 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.292426 Jun 22 10:19:58.678858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 147/290] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:58 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:58.681357 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9314660c-5f81-4384-acbe-18b2e2f59568 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:58.681952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9314660c-5f81-4384-acbe-18b2e2f59568 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:58.688414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9314660c-5f81-4384-acbe-18b2e2f59568 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:58.688877 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9314660c-5f81-4384-acbe-18b2e2f59568 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:58.689641 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9314660c-5f81-4384-acbe-18b2e2f59568 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:58.690070 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9314660c-5f81-4384-acbe-18b2e2f59568 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:58.915970 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9314660c-5f81-4384-acbe-18b2e2f59568 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:58.925667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9314660c-5f81-4384-acbe-18b2e2f59568 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.247958 Jun 22 10:19:58.926562 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 144/291] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:58 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:59.697722 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-af4871b9-a09b-4d6d-baf8-453e6159c126 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:59.697722 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-af4871b9-a09b-4d6d-baf8-453e6159c126 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:59.702842 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-945b8ddb-ce49-481b-baef-f0878ee75182 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:59.703965 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-af4871b9-a09b-4d6d-baf8-453e6159c126 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:59.704118 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-945b8ddb-ce49-481b-baef-f0878ee75182 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:59.704413 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-af4871b9-a09b-4d6d-baf8-453e6159c126 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:59.706925 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-af4871b9-a09b-4d6d-baf8-453e6159c126 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:59.707367 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-af4871b9-a09b-4d6d-baf8-453e6159c126 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:59.711134 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-945b8ddb-ce49-481b-baef-f0878ee75182 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:59.719300 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-945b8ddb-ce49-481b-baef-f0878ee75182 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:59.719300 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-945b8ddb-ce49-481b-baef-f0878ee75182 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:59.719300 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-945b8ddb-ce49-481b-baef-f0878ee75182 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:59.921097 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-945b8ddb-ce49-481b-baef-f0878ee75182 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:59.928871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-af4871b9-a09b-4d6d-baf8-453e6159c126 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:59.931319 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-945b8ddb-ce49-481b-baef-f0878ee75182 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:59.933527 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-945b8ddb-ce49-481b-baef-f0878ee75182 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:59.934763 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-945b8ddb-ce49-481b-baef-f0878ee75182 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.242888 Jun 22 10:19:59.935335 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 148/292] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:59 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:59.937378 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-af4871b9-a09b-4d6d-baf8-453e6159c126 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.245352 Jun 22 10:19:59.941203 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 145/293] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:59 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:59.948672 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4f329a04-85ff-4caf-a1f3-c356847672d4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:59.949717 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4f329a04-85ff-4caf-a1f3-c356847672d4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:59.957165 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4f329a04-85ff-4caf-a1f3-c356847672d4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:59.964853 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4f329a04-85ff-4caf-a1f3-c356847672d4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:59.964853 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4f329a04-85ff-4caf-a1f3-c356847672d4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:59.964853 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4f329a04-85ff-4caf-a1f3-c356847672d4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:00.115137 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4f329a04-85ff-4caf-a1f3-c356847672d4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:00.122612 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4f329a04-85ff-4caf-a1f3-c356847672d4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.180007 Jun 22 10:20:00.123170 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 149/294] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:59 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:00.954013 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ef41ed23-3990-45db-a9d4-53762b84f4c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:00.955240 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ef41ed23-3990-45db-a9d4-53762b84f4c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:00.960675 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e457f3c1-6bc5-40bc-b750-1ea0c08cc25b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:00.961944 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e457f3c1-6bc5-40bc-b750-1ea0c08cc25b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:00.973985 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e457f3c1-6bc5-40bc-b750-1ea0c08cc25b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:00.981071 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e457f3c1-6bc5-40bc-b750-1ea0c08cc25b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:00.981811 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef41ed23-3990-45db-a9d4-53762b84f4c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:00.982883 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef41ed23-3990-45db-a9d4-53762b84f4c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:00.984089 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef41ed23-3990-45db-a9d4-53762b84f4c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:00.984731 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef41ed23-3990-45db-a9d4-53762b84f4c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:00.991821 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e457f3c1-6bc5-40bc-b750-1ea0c08cc25b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:00.991821 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e457f3c1-6bc5-40bc-b750-1ea0c08cc25b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:01.203272 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ef41ed23-3990-45db-a9d4-53762b84f4c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:01.212163 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ef41ed23-3990-45db-a9d4-53762b84f4c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.261882 Jun 22 10:20:01.213175 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 146/295] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:00 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:01.237277 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-23a3496c-9290-434f-bb6d-05b4c94f81b1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:01.237966 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-23a3496c-9290-434f-bb6d-05b4c94f81b1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:01.246625 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-23a3496c-9290-434f-bb6d-05b4c94f81b1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:01.248567 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e457f3c1-6bc5-40bc-b750-1ea0c08cc25b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:01.248688 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-23a3496c-9290-434f-bb6d-05b4c94f81b1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:01.248688 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-23a3496c-9290-434f-bb6d-05b4c94f81b1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:01.248688 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-23a3496c-9290-434f-bb6d-05b4c94f81b1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:01.255436 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e457f3c1-6bc5-40bc-b750-1ea0c08cc25b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:01.256964 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e457f3c1-6bc5-40bc-b750-1ea0c08cc25b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:01.258321 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e457f3c1-6bc5-40bc-b750-1ea0c08cc25b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.304327 Jun 22 10:20:01.259284 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 150/296] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:00 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:01.399097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-23a3496c-9290-434f-bb6d-05b4c94f81b1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:01.409458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-23a3496c-9290-434f-bb6d-05b4c94f81b1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.194935 Jun 22 10:20:01.410478 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 147/297] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:01 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:02.228969 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-88c7d5ab-4669-4bc3-a4ac-add8cbd4fdb6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:02.229607 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-88c7d5ab-4669-4bc3-a4ac-add8cbd4fdb6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:02.236639 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-88c7d5ab-4669-4bc3-a4ac-add8cbd4fdb6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:02.237115 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-88c7d5ab-4669-4bc3-a4ac-add8cbd4fdb6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:02.238133 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-88c7d5ab-4669-4bc3-a4ac-add8cbd4fdb6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:02.238324 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-88c7d5ab-4669-4bc3-a4ac-add8cbd4fdb6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:02.277332 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-61c49c26-0824-4454-8b51-e935e97eec46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:02.279254 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-61c49c26-0824-4454-8b51-e935e97eec46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:02.290133 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-61c49c26-0824-4454-8b51-e935e97eec46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:02.290932 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-61c49c26-0824-4454-8b51-e935e97eec46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:02.293678 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-61c49c26-0824-4454-8b51-e935e97eec46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:02.295790 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-61c49c26-0824-4454-8b51-e935e97eec46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:02.477171 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-88c7d5ab-4669-4bc3-a4ac-add8cbd4fdb6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:02.493876 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-88c7d5ab-4669-4bc3-a4ac-add8cbd4fdb6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.267384 Jun 22 10:20:02.502610 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 151/298] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:02 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:02.504700 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-61c49c26-0824-4454-8b51-e935e97eec46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:02.512064 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d2d1f393-80fb-4f03-8ab6-24bc683d5a8b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:02.514230 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d2d1f393-80fb-4f03-8ab6-24bc683d5a8b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:02.514375 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-61c49c26-0824-4454-8b51-e935e97eec46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:02.515812 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-61c49c26-0824-4454-8b51-e935e97eec46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:02.517534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-61c49c26-0824-4454-8b51-e935e97eec46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.243726 Jun 22 10:20:02.522085 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 148/299] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:02 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:02.522219 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d2d1f393-80fb-4f03-8ab6-24bc683d5a8b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:02.522651 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d2d1f393-80fb-4f03-8ab6-24bc683d5a8b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:02.523591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d2d1f393-80fb-4f03-8ab6-24bc683d5a8b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:02.524176 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d2d1f393-80fb-4f03-8ab6-24bc683d5a8b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:02.670586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d2d1f393-80fb-4f03-8ab6-24bc683d5a8b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:02.678024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d2d1f393-80fb-4f03-8ab6-24bc683d5a8b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.173218 Jun 22 10:20:02.678587 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 152/300] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:02 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:03.409307 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-74dbbb9a-3c8f-4392-9c8a-02fb2e54d782 req-4a795963-68e2-444a-a148-6705dbb781cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5", "name": "network-vif-plugged", "status": "completed", "tag": "54ad74cf-b62f-42ef-8cee-15d7aef7f8e7"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:03.425154 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-74dbbb9a-3c8f-4392-9c8a-02fb2e54d782 req-4a795963-68e2-444a-a148-6705dbb781cd service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:03.425843 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-74dbbb9a-3c8f-4392-9c8a-02fb2e54d782 req-4a795963-68e2-444a-a148-6705dbb781cd service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:03.438072 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-74dbbb9a-3c8f-4392-9c8a-02fb2e54d782 req-4a795963-68e2-444a-a148-6705dbb781cd service nova] Creating event network-vif-plugged:54ad74cf-b62f-42ef-8cee-15d7aef7f8e7 for instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 on hv-cinder-84327 Jun 22 10:20:03.443395 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-74dbbb9a-3c8f-4392-9c8a-02fb2e54d782 req-4a795963-68e2-444a-a148-6705dbb781cd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039242 Jun 22 10:20:03.444057 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 149/301] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:03.510224 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2b2d3ff6-8173-4eae-b658-7b3868ef690f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:03.511051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2b2d3ff6-8173-4eae-b658-7b3868ef690f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:03.518558 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2b2d3ff6-8173-4eae-b658-7b3868ef690f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:03.518987 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2b2d3ff6-8173-4eae-b658-7b3868ef690f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:03.519813 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2b2d3ff6-8173-4eae-b658-7b3868ef690f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:03.520252 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2b2d3ff6-8173-4eae-b658-7b3868ef690f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:03.538878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8f505840-f273-4be0-8c2b-ccf22436431f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:03.539600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8f505840-f273-4be0-8c2b-ccf22436431f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:03.564931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8f505840-f273-4be0-8c2b-ccf22436431f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:03.564931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8f505840-f273-4be0-8c2b-ccf22436431f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:03.564931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8f505840-f273-4be0-8c2b-ccf22436431f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:03.564931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8f505840-f273-4be0-8c2b-ccf22436431f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:03.740891 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2b2d3ff6-8173-4eae-b658-7b3868ef690f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:03.749010 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2b2d3ff6-8173-4eae-b658-7b3868ef690f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.243099 Jun 22 10:20:03.749587 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 153/302] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:03 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:03.764919 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-cbf4bc23-df10-4936-a6dc-6398a47d3a02 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:03.765930 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-cbf4bc23-df10-4936-a6dc-6398a47d3a02 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:03.775557 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cbf4bc23-df10-4936-a6dc-6398a47d3a02 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:03.776137 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cbf4bc23-df10-4936-a6dc-6398a47d3a02 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:03.777157 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cbf4bc23-df10-4936-a6dc-6398a47d3a02 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:03.778094 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cbf4bc23-df10-4936-a6dc-6398a47d3a02 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:03.792914 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8f505840-f273-4be0-8c2b-ccf22436431f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:03.805551 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8f505840-f273-4be0-8c2b-ccf22436431f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:03.807621 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8f505840-f273-4be0-8c2b-ccf22436431f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:03.809660 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-8f505840-f273-4be0-8c2b-ccf22436431f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.274967 Jun 22 10:20:03.821933 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 150/303] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:03 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:03.936046 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-cbf4bc23-df10-4936-a6dc-6398a47d3a02 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:03.943850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-cbf4bc23-df10-4936-a6dc-6398a47d3a02 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.190236 Jun 22 10:20:03.944402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 154/304] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:03 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:04.587298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fff01b37-6c07-4d72-a272-a312773332bf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b3ad03e-3eae-4520-967f-12e28f9f5ba0"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:04.590846 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-fff01b37-6c07-4d72-a272-a312773332bf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:04.605804 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fff01b37-6c07-4d72-a272-a312773332bf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:04.606262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fff01b37-6c07-4d72-a272-a312773332bf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:04.611643 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fff01b37-6c07-4d72-a272-a312773332bf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:04.611643 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fff01b37-6c07-4d72-a272-a312773332bf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:04.766782 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3cefb2a6-79a5-43ab-ae9e-dc080694cd10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:04.768245 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3cefb2a6-79a5-43ab-ae9e-dc080694cd10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:04.778160 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3cefb2a6-79a5-43ab-ae9e-dc080694cd10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:04.787386 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3cefb2a6-79a5-43ab-ae9e-dc080694cd10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:04.789038 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3cefb2a6-79a5-43ab-ae9e-dc080694cd10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:04.789787 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3cefb2a6-79a5-43ab-ae9e-dc080694cd10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:05.268185 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3cefb2a6-79a5-43ab-ae9e-dc080694cd10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:05.282636 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3cefb2a6-79a5-43ab-ae9e-dc080694cd10 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.518505 Jun 22 10:20:05.284943 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 155/305] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:04 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:05.299888 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7ab19f47-afdb-4283-9257-56ae0bfa840f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:05.300498 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7ab19f47-afdb-4283-9257-56ae0bfa840f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:05.313457 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7ab19f47-afdb-4283-9257-56ae0bfa840f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:05.315431 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7ab19f47-afdb-4283-9257-56ae0bfa840f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:05.317451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7ab19f47-afdb-4283-9257-56ae0bfa840f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:05.318133 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7ab19f47-afdb-4283-9257-56ae0bfa840f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:05.505134 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7ab19f47-afdb-4283-9257-56ae0bfa840f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:05.515244 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7ab19f47-afdb-4283-9257-56ae0bfa840f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:05.516984 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7ab19f47-afdb-4283-9257-56ae0bfa840f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:05.518141 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7ab19f47-afdb-4283-9257-56ae0bfa840f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.231887 Jun 22 10:20:05.518858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 156/306] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:05 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:05.523545 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b47184a2-51c1-461d-b51e-7946afb3df98 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:05.524337 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b47184a2-51c1-461d-b51e-7946afb3df98 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:05.530503 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b47184a2-51c1-461d-b51e-7946afb3df98 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:05.531347 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b47184a2-51c1-461d-b51e-7946afb3df98 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:05.532276 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b47184a2-51c1-461d-b51e-7946afb3df98 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:05.533482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b47184a2-51c1-461d-b51e-7946afb3df98 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:05.674376 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b47184a2-51c1-461d-b51e-7946afb3df98 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:05.682715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b47184a2-51c1-461d-b51e-7946afb3df98 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.162679 Jun 22 10:20:05.695082 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 157/307] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:05 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:05.748362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-fff01b37-6c07-4d72-a272-a312773332bf tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "POST /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.168889 Jun 22 10:20:05.748362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 151/308] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:20:04 2022] POST /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f/os-volume_attachments => generated 194 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:06.301163 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ba049ec3-45d7-48db-8a27-16a9d9e04598 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:06.301792 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ba049ec3-45d7-48db-8a27-16a9d9e04598 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:06.308083 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ba049ec3-45d7-48db-8a27-16a9d9e04598 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:06.308524 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ba049ec3-45d7-48db-8a27-16a9d9e04598 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:06.309538 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ba049ec3-45d7-48db-8a27-16a9d9e04598 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:06.309966 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ba049ec3-45d7-48db-8a27-16a9d9e04598 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:06.496177 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ba049ec3-45d7-48db-8a27-16a9d9e04598 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:06.505281 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ba049ec3-45d7-48db-8a27-16a9d9e04598 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.207862 Jun 22 10:20:06.508450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 158/309] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:06 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:06.536931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0522a8c6-6264-4f75-8cb3-3a0bf675e8b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:06.537636 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0522a8c6-6264-4f75-8cb3-3a0bf675e8b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:06.545663 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0522a8c6-6264-4f75-8cb3-3a0bf675e8b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:06.546115 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0522a8c6-6264-4f75-8cb3-3a0bf675e8b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:06.546901 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0522a8c6-6264-4f75-8cb3-3a0bf675e8b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:06.547334 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0522a8c6-6264-4f75-8cb3-3a0bf675e8b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:06.702125 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-43898247-f532-4869-88ea-49323eb56cea tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:06.702727 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-43898247-f532-4869-88ea-49323eb56cea tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:06.715512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0522a8c6-6264-4f75-8cb3-3a0bf675e8b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:06.715986 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-43898247-f532-4869-88ea-49323eb56cea tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:06.715986 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-43898247-f532-4869-88ea-49323eb56cea tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:06.715986 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-43898247-f532-4869-88ea-49323eb56cea tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:06.715986 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-43898247-f532-4869-88ea-49323eb56cea tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:06.722128 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0522a8c6-6264-4f75-8cb3-3a0bf675e8b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:06.725975 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:06.727994 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0522a8c6-6264-4f75-8cb3-3a0bf675e8b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:06.729785 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0522a8c6-6264-4f75-8cb3-3a0bf675e8b5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.197980 Jun 22 10:20:06.736059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 152/310] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:06 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:06.900235 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-43898247-f532-4869-88ea-49323eb56cea tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:06.909029 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-43898247-f532-4869-88ea-49323eb56cea tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1363 microversion: 2.1 time: 0.209925 Jun 22 10:20:06.909981 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 159/311] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:06 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:07.522915 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-446230cb-32d4-46fa-a1cb-6dbff033bc68 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:07.524033 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-446230cb-32d4-46fa-a1cb-6dbff033bc68 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:07.530396 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-446230cb-32d4-46fa-a1cb-6dbff033bc68 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.531170 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-446230cb-32d4-46fa-a1cb-6dbff033bc68 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:07.532093 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-446230cb-32d4-46fa-a1cb-6dbff033bc68 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.532736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-446230cb-32d4-46fa-a1cb-6dbff033bc68 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:07.667693 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-062b1a36-f2cb-475e-a55a-6aa4e1532ea3 req-aa0781d8-9910-4e81-9738-111710ac07f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fa8c96-e39d-47ce-86a0-9d7d7eaf099f", "name": "network-vif-plugged", "status": "completed", "tag": "9c2ee9e8-f445-4686-bacb-0cbc5c3c71de"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:07.679434 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-062b1a36-f2cb-475e-a55a-6aa4e1532ea3 req-aa0781d8-9910-4e81-9738-111710ac07f6 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.680286 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-062b1a36-f2cb-475e-a55a-6aa4e1532ea3 req-aa0781d8-9910-4e81-9738-111710ac07f6 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:07.693936 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-062b1a36-f2cb-475e-a55a-6aa4e1532ea3 req-aa0781d8-9910-4e81-9738-111710ac07f6 service nova] Creating event network-vif-plugged:9c2ee9e8-f445-4686-bacb-0cbc5c3c71de for instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f on hv-cinder-84327 Jun 22 10:20:07.699763 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-062b1a36-f2cb-475e-a55a-6aa4e1532ea3 req-aa0781d8-9910-4e81-9738-111710ac07f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037231 Jun 22 10:20:07.701202 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 160/312] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:07.707413 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-446230cb-32d4-46fa-a1cb-6dbff033bc68 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:07.723993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-446230cb-32d4-46fa-a1cb-6dbff033bc68 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.204752 Jun 22 10:20:07.725037 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 153/313] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:07 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:07.755152 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-359e0c3d-b21a-4644-bb8b-84305e3ffb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:07.755989 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-359e0c3d-b21a-4644-bb8b-84305e3ffb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:07.762451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-359e0c3d-b21a-4644-bb8b-84305e3ffb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.762893 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-359e0c3d-b21a-4644-bb8b-84305e3ffb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:07.763652 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-359e0c3d-b21a-4644-bb8b-84305e3ffb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.764354 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-359e0c3d-b21a-4644-bb8b-84305e3ffb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:07.901660 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-359e0c3d-b21a-4644-bb8b-84305e3ffb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:07.911102 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-359e0c3d-b21a-4644-bb8b-84305e3ffb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:07.916242 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-359e0c3d-b21a-4644-bb8b-84305e3ffb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:07.916242 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-359e0c3d-b21a-4644-bb8b-84305e3ffb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.163739 Jun 22 10:20:07.916242 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 161/314] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:07 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:07.926740 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5961f28d-95da-48f5-b583-d604cfca6859 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:07.927688 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5961f28d-95da-48f5-b583-d604cfca6859 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:07.945438 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5961f28d-95da-48f5-b583-d604cfca6859 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.946139 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5961f28d-95da-48f5-b583-d604cfca6859 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:07.947553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5961f28d-95da-48f5-b583-d604cfca6859 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.948155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5961f28d-95da-48f5-b583-d604cfca6859 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:08.110143 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5961f28d-95da-48f5-b583-d604cfca6859 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:08.118770 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5961f28d-95da-48f5-b583-d604cfca6859 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1548 microversion: 2.1 time: 0.197017 Jun 22 10:20:08.119435 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 154/315] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:07 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:08.136474 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-46ec4432-1bf5-4091-8956-245e86ac00e2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:08.137116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-46ec4432-1bf5-4091-8956-245e86ac00e2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:08.144350 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-46ec4432-1bf5-4091-8956-245e86ac00e2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:08.144806 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-46ec4432-1bf5-4091-8956-245e86ac00e2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:08.145813 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-46ec4432-1bf5-4091-8956-245e86ac00e2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:08.146318 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-46ec4432-1bf5-4091-8956-245e86ac00e2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:08.231820 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-46ec4432-1bf5-4091-8956-245e86ac00e2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099335 Jun 22 10:20:08.232669 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 162/316] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jun 22 10:20:08 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:08.741512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3b390c5b-951f-4f63-bb49-25ce4e2221aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:08.743182 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3b390c5b-951f-4f63-bb49-25ce4e2221aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:08.755867 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3b390c5b-951f-4f63-bb49-25ce4e2221aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:08.757559 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3b390c5b-951f-4f63-bb49-25ce4e2221aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:08.760235 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3b390c5b-951f-4f63-bb49-25ce4e2221aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:08.761437 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3b390c5b-951f-4f63-bb49-25ce4e2221aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:08.932661 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-fbd02464-8a8d-4bf4-abb1-9c9f0470d0ab tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:08.933326 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-fbd02464-8a8d-4bf4-abb1-9c9f0470d0ab tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:08.946943 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fbd02464-8a8d-4bf4-abb1-9c9f0470d0ab tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:08.946943 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fbd02464-8a8d-4bf4-abb1-9c9f0470d0ab tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:08.946943 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fbd02464-8a8d-4bf4-abb1-9c9f0470d0ab tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:08.946943 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fbd02464-8a8d-4bf4-abb1-9c9f0470d0ab tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:09.230883 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3b390c5b-951f-4f63-bb49-25ce4e2221aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:09.250558 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3b390c5b-951f-4f63-bb49-25ce4e2221aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.512910 Jun 22 10:20:09.254904 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 155/317] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:08 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:09.268444 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-fbd02464-8a8d-4bf4-abb1-9c9f0470d0ab tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:09.276833 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-fbd02464-8a8d-4bf4-abb1-9c9f0470d0ab tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:09.278404 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-fbd02464-8a8d-4bf4-abb1-9c9f0470d0ab tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:09.279463 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-fbd02464-8a8d-4bf4-abb1-9c9f0470d0ab tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.350720 Jun 22 10:20:09.281266 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 163/318] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:08 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:10.017230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-185b0c41-8c0a-418e-8d11-5a399b76d8cc req-549357af-5751-42de-b123-d2c6317c954e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5", "tag": "54ad74cf-b62f-42ef-8cee-15d7aef7f8e7"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:10.026421 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-185b0c41-8c0a-418e-8d11-5a399b76d8cc req-549357af-5751-42de-b123-d2c6317c954e service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:10.029411 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-185b0c41-8c0a-418e-8d11-5a399b76d8cc req-549357af-5751-42de-b123-d2c6317c954e service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:10.038700 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-185b0c41-8c0a-418e-8d11-5a399b76d8cc req-549357af-5751-42de-b123-d2c6317c954e service nova] Creating event network-changed:54ad74cf-b62f-42ef-8cee-15d7aef7f8e7 for instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 on hv-cinder-84327 Jun 22 10:20:10.043845 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-185b0c41-8c0a-418e-8d11-5a399b76d8cc req-549357af-5751-42de-b123-d2c6317c954e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030479 Jun 22 10:20:10.044439 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 156/319] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:10.272431 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a85debfb-2edf-4b4d-83cd-b708d3830487 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:10.273252 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a85debfb-2edf-4b4d-83cd-b708d3830487 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:10.285830 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a85debfb-2edf-4b4d-83cd-b708d3830487 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:10.289311 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a85debfb-2edf-4b4d-83cd-b708d3830487 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:10.289311 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a85debfb-2edf-4b4d-83cd-b708d3830487 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:10.289311 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a85debfb-2edf-4b4d-83cd-b708d3830487 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:10.298768 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d182ed37-8231-4303-b0d7-96c6c6fdc271 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:10.299527 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d182ed37-8231-4303-b0d7-96c6c6fdc271 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:10.318098 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d182ed37-8231-4303-b0d7-96c6c6fdc271 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:10.318098 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d182ed37-8231-4303-b0d7-96c6c6fdc271 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:10.318098 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d182ed37-8231-4303-b0d7-96c6c6fdc271 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:10.318098 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d182ed37-8231-4303-b0d7-96c6c6fdc271 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:10.632604 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a85debfb-2edf-4b4d-83cd-b708d3830487 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:10.645628 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a85debfb-2edf-4b4d-83cd-b708d3830487 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.379969 Jun 22 10:20:10.646526 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 164/320] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:10 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:10.674387 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d182ed37-8231-4303-b0d7-96c6c6fdc271 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:10.689007 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d182ed37-8231-4303-b0d7-96c6c6fdc271 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:10.693444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d182ed37-8231-4303-b0d7-96c6c6fdc271 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:10.693444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d182ed37-8231-4303-b0d7-96c6c6fdc271 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1407 microversion: 2.20 time: 0.398026 Jun 22 10:20:10.693444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 157/321] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:10 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:20:11.663091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9ec3674f-1c9c-45d1-9d17-ccfe91630d3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:11.663696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9ec3674f-1c9c-45d1-9d17-ccfe91630d3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:11.671213 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9ec3674f-1c9c-45d1-9d17-ccfe91630d3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:11.681827 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9ec3674f-1c9c-45d1-9d17-ccfe91630d3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:11.681827 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9ec3674f-1c9c-45d1-9d17-ccfe91630d3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:11.681827 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9ec3674f-1c9c-45d1-9d17-ccfe91630d3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:11.710135 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b2f02d38-5c18-4a8c-9137-5448feb03b90 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:11.711430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b2f02d38-5c18-4a8c-9137-5448feb03b90 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:11.719103 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b2f02d38-5c18-4a8c-9137-5448feb03b90 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:11.720105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b2f02d38-5c18-4a8c-9137-5448feb03b90 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:11.721128 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b2f02d38-5c18-4a8c-9137-5448feb03b90 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:11.721720 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b2f02d38-5c18-4a8c-9137-5448feb03b90 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:11.747865 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:11.947083 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9ec3674f-1c9c-45d1-9d17-ccfe91630d3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:11.954919 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9ec3674f-1c9c-45d1-9d17-ccfe91630d3b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.296032 Jun 22 10:20:11.965243 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 165/322] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:11 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:11.981662 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b2f02d38-5c18-4a8c-9137-5448feb03b90 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:11.991551 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b2f02d38-5c18-4a8c-9137-5448feb03b90 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:11.993701 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b2f02d38-5c18-4a8c-9137-5448feb03b90 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:11.995050 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b2f02d38-5c18-4a8c-9137-5448feb03b90 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1600 microversion: 2.20 time: 0.289524 Jun 22 10:20:11.995761 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 158/323] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:11 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1600 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:20:12.017251 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-82b3044b-1e64-4aeb-b6cf-8d8b82bed741 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:12.018023 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-82b3044b-1e64-4aeb-b6cf-8d8b82bed741 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:12.024389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82b3044b-1e64-4aeb-b6cf-8d8b82bed741 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:12.024950 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82b3044b-1e64-4aeb-b6cf-8d8b82bed741 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:12.025799 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82b3044b-1e64-4aeb-b6cf-8d8b82bed741 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:12.026329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82b3044b-1e64-4aeb-b6cf-8d8b82bed741 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:12.155130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-82b3044b-1e64-4aeb-b6cf-8d8b82bed741 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.142836 Jun 22 10:20:12.156561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 166/324] 10.222.0.46 () {60 vars in 1315 bytes} [Wed Jun 22 10:20:12 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:20:12.972457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-da4033c0-e32a-4097-b83f-7cda2dfc5dd5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:12.974092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-da4033c0-e32a-4097-b83f-7cda2dfc5dd5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:12.989401 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-da4033c0-e32a-4097-b83f-7cda2dfc5dd5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:12.990131 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-da4033c0-e32a-4097-b83f-7cda2dfc5dd5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:12.994817 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-da4033c0-e32a-4097-b83f-7cda2dfc5dd5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:12.995272 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-da4033c0-e32a-4097-b83f-7cda2dfc5dd5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:13.169760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-da4033c0-e32a-4097-b83f-7cda2dfc5dd5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:13.178565 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-da4033c0-e32a-4097-b83f-7cda2dfc5dd5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.210704 Jun 22 10:20:13.179349 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 159/325] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:12 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:13.958829 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-500f09db-4021-4691-aadf-023b7f913b7c req-1e032c40-b641-47e4-9f5a-f65d7fabe74e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86fa8c96-e39d-47ce-86a0-9d7d7eaf099f", "tag": "9c2ee9e8-f445-4686-bacb-0cbc5c3c71de"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:13.967516 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-500f09db-4021-4691-aadf-023b7f913b7c req-1e032c40-b641-47e4-9f5a-f65d7fabe74e service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:13.968149 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-500f09db-4021-4691-aadf-023b7f913b7c req-1e032c40-b641-47e4-9f5a-f65d7fabe74e service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:13.981095 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-500f09db-4021-4691-aadf-023b7f913b7c req-1e032c40-b641-47e4-9f5a-f65d7fabe74e service nova] Creating event network-changed:9c2ee9e8-f445-4686-bacb-0cbc5c3c71de for instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f on hv-cinder-84327 Jun 22 10:20:13.986833 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-500f09db-4021-4691-aadf-023b7f913b7c req-1e032c40-b641-47e4-9f5a-f65d7fabe74e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031964 Jun 22 10:20:13.991985 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 167/326] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:14.204621 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-79970c6c-c505-412d-84f9-d7a2069908a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:14.207205 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-79970c6c-c505-412d-84f9-d7a2069908a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:14.220536 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-79970c6c-c505-412d-84f9-d7a2069908a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:14.220536 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-79970c6c-c505-412d-84f9-d7a2069908a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:14.226922 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-79970c6c-c505-412d-84f9-d7a2069908a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:14.227364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-79970c6c-c505-412d-84f9-d7a2069908a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:14.546254 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-79970c6c-c505-412d-84f9-d7a2069908a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:14.557578 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-79970c6c-c505-412d-84f9-d7a2069908a5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.363091 Jun 22 10:20:14.558882 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 160/327] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:14 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:15.576588 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2366b0c9-0737-424a-ab2e-96fccba013c0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:15.577341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2366b0c9-0737-424a-ab2e-96fccba013c0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:15.586015 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2366b0c9-0737-424a-ab2e-96fccba013c0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:15.586712 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2366b0c9-0737-424a-ab2e-96fccba013c0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:15.587493 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2366b0c9-0737-424a-ab2e-96fccba013c0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:15.587929 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2366b0c9-0737-424a-ab2e-96fccba013c0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:15.743705 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2366b0c9-0737-424a-ab2e-96fccba013c0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:15.754038 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2366b0c9-0737-424a-ab2e-96fccba013c0 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.181692 Jun 22 10:20:15.755130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 168/328] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:15 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:16.775217 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6c2c74da-e624-4130-b023-c5534601d416 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:16.776923 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6c2c74da-e624-4130-b023-c5534601d416 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:16.786112 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c2c74da-e624-4130-b023-c5534601d416 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:16.787505 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c2c74da-e624-4130-b023-c5534601d416 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:16.788667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c2c74da-e624-4130-b023-c5534601d416 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:16.789382 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c2c74da-e624-4130-b023-c5534601d416 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:16.957200 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6c2c74da-e624-4130-b023-c5534601d416 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:16.973946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6c2c74da-e624-4130-b023-c5534601d416 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.204561 Jun 22 10:20:16.978643 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 161/329] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:16 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:17.091919 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ea9374be-441a-42be-9fe7-d9486ddc95de tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:17.092462 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ea9374be-441a-42be-9fe7-d9486ddc95de tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:17.103806 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ea9374be-441a-42be-9fe7-d9486ddc95de tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:17.103806 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ea9374be-441a-42be-9fe7-d9486ddc95de tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:17.103806 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ea9374be-441a-42be-9fe7-d9486ddc95de tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:17.104012 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ea9374be-441a-42be-9fe7-d9486ddc95de tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:17.132757 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ea9374be-441a-42be-9fe7-d9486ddc95de tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:20:17.534881 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ea9374be-441a-42be-9fe7-d9486ddc95de tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 204 len: 0 microversion: 2.1 time: 0.445205 Jun 22 10:20:17.537217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 169/330] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:20:17 2022] DELETE /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:20:17.557904 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-71e0e211-2f81-4620-ba33-c750fb1a6438 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:17.557904 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-71e0e211-2f81-4620-ba33-c750fb1a6438 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:17.567904 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71e0e211-2f81-4620-ba33-c750fb1a6438 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:17.567904 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71e0e211-2f81-4620-ba33-c750fb1a6438 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:17.567904 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71e0e211-2f81-4620-ba33-c750fb1a6438 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:17.567904 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71e0e211-2f81-4620-ba33-c750fb1a6438 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:17.736308 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-71e0e211-2f81-4620-ba33-c750fb1a6438 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:17.748252 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-71e0e211-2f81-4620-ba33-c750fb1a6438 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1555 microversion: 2.1 time: 0.202507 Jun 22 10:20:17.748861 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 162/331] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:17 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1555 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:17.997684 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-23ff88d8-d63b-456e-9f8c-157b2c097f02 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:17.998506 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-23ff88d8-d63b-456e-9f8c-157b2c097f02 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:18.005769 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-23ff88d8-d63b-456e-9f8c-157b2c097f02 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:18.006220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-23ff88d8-d63b-456e-9f8c-157b2c097f02 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:18.006994 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-23ff88d8-d63b-456e-9f8c-157b2c097f02 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:18.007428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-23ff88d8-d63b-456e-9f8c-157b2c097f02 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:18.156357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-23ff88d8-d63b-456e-9f8c-157b2c097f02 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:18.160963 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-23ff88d8-d63b-456e-9f8c-157b2c097f02 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.170090 Jun 22 10:20:18.161524 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 170/332] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:17 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:18.775875 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9ce78723-feeb-4a51-95b1-086a740f03ec tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:18.776513 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9ce78723-feeb-4a51-95b1-086a740f03ec tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:18.783116 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9ce78723-feeb-4a51-95b1-086a740f03ec tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:18.783747 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9ce78723-feeb-4a51-95b1-086a740f03ec tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:18.784514 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9ce78723-feeb-4a51-95b1-086a740f03ec tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:18.785148 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9ce78723-feeb-4a51-95b1-086a740f03ec tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:18.950940 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9ce78723-feeb-4a51-95b1-086a740f03ec tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:18.960113 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9ce78723-feeb-4a51-95b1-086a740f03ec tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1555 microversion: 2.1 time: 0.188318 Jun 22 10:20:18.960690 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 163/333] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:18 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1555 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:19.178793 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8ddf6e06-b259-45b5-a347-5c222d95f59e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:19.179486 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8ddf6e06-b259-45b5-a347-5c222d95f59e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:19.186649 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8ddf6e06-b259-45b5-a347-5c222d95f59e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:19.187102 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8ddf6e06-b259-45b5-a347-5c222d95f59e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:19.187873 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8ddf6e06-b259-45b5-a347-5c222d95f59e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:19.188302 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8ddf6e06-b259-45b5-a347-5c222d95f59e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:19.361843 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8ddf6e06-b259-45b5-a347-5c222d95f59e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:19.371289 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8ddf6e06-b259-45b5-a347-5c222d95f59e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.197422 Jun 22 10:20:19.372118 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 171/334] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:19 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:19.790919 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-804978737", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "networks": [{"uuid": "6fe2857b-94e4-4b84-881e-f8d24be067eb"}]}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:19.849296 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.network.neutron [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] validate_networks() for [('6fe2857b-94e4-4b84-881e-f8d24be067eb', None, None, None, None, None)] {{(pid=118327) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:20:19.976649 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5a047b5b-6cf4-43e2-8cda-9ee443288ae9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:19.978863 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5a047b5b-6cf4-43e2-8cda-9ee443288ae9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:19.985402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5a047b5b-6cf4-43e2-8cda-9ee443288ae9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:19.986185 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5a047b5b-6cf4-43e2-8cda-9ee443288ae9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:19.987235 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5a047b5b-6cf4-43e2-8cda-9ee443288ae9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:19.987968 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5a047b5b-6cf4-43e2-8cda-9ee443288ae9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:20.230818 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5a047b5b-6cf4-43e2-8cda-9ee443288ae9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:20.240735 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5a047b5b-6cf4-43e2-8cda-9ee443288ae9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1555 microversion: 2.1 time: 0.268143 Jun 22 10:20:20.241708 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 172/335] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:19 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:20.332635 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Flavor limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:20:20.333102 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Image limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:20:20.333580 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Flavor pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:20:20.334130 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Image pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:20:20.334555 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:20:20.343522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:20.343967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:20.344764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:20.345228 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:20.362687 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Getting quotas for project 9e06f1a9b667414b8d663033c7053b76. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:20:20.367330 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Getting quotas for user c2e02737f0cc423d95db9c3324f7215e and project 9e06f1a9b667414b8d663033c7053b76. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:20:20.378901 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Going to run 1 instances... {{(pid=118327) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:20:20.381836 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:20:20.387924 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-85f9703a-9601-44fa-8f55-888d6d396880 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:20.388564 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-85f9703a-9601-44fa-8f55-888d6d396880 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:20.394876 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-85f9703a-9601-44fa-8f55-888d6d396880 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:20.395332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-85f9703a-9601-44fa-8f55-888d6d396880 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:20.396091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-85f9703a-9601-44fa-8f55-888d6d396880 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:20.396528 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-85f9703a-9601-44fa-8f55-888d6d396880 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:20.468344 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-eff4a1f3-ed11-4394-8e3a-914cc8dbda2c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681291 Jun 22 10:20:20.474209 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 164/336] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:20:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:20:20.479681 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-77b538b0-104a-4da6-af36-9e15b2580656 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:20.480530 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-77b538b0-104a-4da6-af36-9e15b2580656 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:20.567968 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-77b538b0-104a-4da6-af36-9e15b2580656 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:20.581054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-77b538b0-104a-4da6-af36-9e15b2580656 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1213 microversion: 2.1 time: 0.105292 Jun 22 10:20:20.584094 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 165/337] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:20 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:20.606957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-85f9703a-9601-44fa-8f55-888d6d396880 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:20.621008 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-85f9703a-9601-44fa-8f55-888d6d396880 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.236728 Jun 22 10:20:20.630245 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 173/338] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:20 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:21.212234 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-eff47866-c79f-4d09-a3f8-0d9d26649738 req-3870032b-bd97-44d6-994b-ca3805230ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8701ce7d-38d6-4383-9491-e2d4740a2f5f", "name": "network-vif-deleted", "tag": "39ba7490-4bda-4946-a369-308acdb5baa3"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:21.227941 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-eff47866-c79f-4d09-a3f8-0d9d26649738 req-3870032b-bd97-44d6-994b-ca3805230ac4 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:21.228442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-eff47866-c79f-4d09-a3f8-0d9d26649738 req-3870032b-bd97-44d6-994b-ca3805230ac4 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:21.256036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-eff47866-c79f-4d09-a3f8-0d9d26649738 req-3870032b-bd97-44d6-994b-ca3805230ac4 service nova] Creating event network-vif-deleted:39ba7490-4bda-4946-a369-308acdb5baa3 for instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f on hv-cinder-84327 Jun 22 10:20:21.258717 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-de8cf2e9-c317-41e5-91fa-79936081bbe9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:21.259305 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-de8cf2e9-c317-41e5-91fa-79936081bbe9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:21.271038 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de8cf2e9-c317-41e5-91fa-79936081bbe9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:21.272948 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de8cf2e9-c317-41e5-91fa-79936081bbe9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:21.273916 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de8cf2e9-c317-41e5-91fa-79936081bbe9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:21.276535 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de8cf2e9-c317-41e5-91fa-79936081bbe9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:21.281381 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-eff47866-c79f-4d09-a3f8-0d9d26649738 req-3870032b-bd97-44d6-994b-ca3805230ac4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068017 Jun 22 10:20:21.282013 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 166/339] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:21.398881 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-de8cf2e9-c317-41e5-91fa-79936081bbe9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:21.408326 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-de8cf2e9-c317-41e5-91fa-79936081bbe9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1513 microversion: 2.1 time: 0.153341 Jun 22 10:20:21.419137 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 174/340] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:21 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:21.608586 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-58f6774e-4d8b-44af-a640-2f7a4650f449 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:21.610853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-58f6774e-4d8b-44af-a640-2f7a4650f449 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:21.642317 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e6605044-7f09-4ba9-8fc7-aea9c5b43e88 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:21.643280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e6605044-7f09-4ba9-8fc7-aea9c5b43e88 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:21.656353 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e6605044-7f09-4ba9-8fc7-aea9c5b43e88 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:21.657223 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e6605044-7f09-4ba9-8fc7-aea9c5b43e88 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:21.661938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e6605044-7f09-4ba9-8fc7-aea9c5b43e88 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:21.661938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e6605044-7f09-4ba9-8fc7-aea9c5b43e88 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:21.695272 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-58f6774e-4d8b-44af-a640-2f7a4650f449 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:21.703681 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-58f6774e-4d8b-44af-a640-2f7a4650f449 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1213 microversion: 2.1 time: 0.100297 Jun 22 10:20:21.705118 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 167/341] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:21 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:21.972761 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e6605044-7f09-4ba9-8fc7-aea9c5b43e88 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:21.985276 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e6605044-7f09-4ba9-8fc7-aea9c5b43e88 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.349456 Jun 22 10:20:21.985276 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 175/342] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:21 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:22.425476 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d8f45849-2f8d-4dd1-8741-cae833d708a0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:22.426893 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d8f45849-2f8d-4dd1-8741-cae833d708a0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:22.435019 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8f45849-2f8d-4dd1-8741-cae833d708a0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:22.436760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8f45849-2f8d-4dd1-8741-cae833d708a0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:22.437642 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8f45849-2f8d-4dd1-8741-cae833d708a0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:22.438114 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8f45849-2f8d-4dd1-8741-cae833d708a0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:22.481876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8f45849-2f8d-4dd1-8741-cae833d708a0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:22.482336 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8f45849-2f8d-4dd1-8741-cae833d708a0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:22.482787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-d8f45849-2f8d-4dd1-8741-cae833d708a0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lazy-loading 'fault' on Instance uuid 8701ce7d-38d6-4383-9491-e2d4740a2f5f {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:20:22.532003 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d8f45849-2f8d-4dd1-8741-cae833d708a0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:22.541519 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d8f45849-2f8d-4dd1-8741-cae833d708a0 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1351 microversion: 2.1 time: 0.119349 Jun 22 10:20:22.542228 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 168/343] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:22 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:22.724468 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a601e718-9d9c-4d90-a4fe-07fbab941911 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:22.725659 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a601e718-9d9c-4d90-a4fe-07fbab941911 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:22.732598 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a601e718-9d9c-4d90-a4fe-07fbab941911 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:22.733161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a601e718-9d9c-4d90-a4fe-07fbab941911 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:22.733978 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a601e718-9d9c-4d90-a4fe-07fbab941911 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:22.735664 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a601e718-9d9c-4d90-a4fe-07fbab941911 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:22.739775 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:22.805445 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a601e718-9d9c-4d90-a4fe-07fbab941911 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:22.817282 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a601e718-9d9c-4d90-a4fe-07fbab941911 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1265 microversion: 2.1 time: 0.099439 Jun 22 10:20:22.818173 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 176/344] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:22 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:23.001797 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2f430a56-a4f6-405a-8f2a-2cf19ad642a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:23.002469 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2f430a56-a4f6-405a-8f2a-2cf19ad642a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:23.008681 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2f430a56-a4f6-405a-8f2a-2cf19ad642a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:23.009159 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2f430a56-a4f6-405a-8f2a-2cf19ad642a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:23.009919 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2f430a56-a4f6-405a-8f2a-2cf19ad642a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:23.010350 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2f430a56-a4f6-405a-8f2a-2cf19ad642a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:23.145025 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2f430a56-a4f6-405a-8f2a-2cf19ad642a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:23.153492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2f430a56-a4f6-405a-8f2a-2cf19ad642a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.155489 Jun 22 10:20:23.154167 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 169/345] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:22 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:23.562637 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ab8880d0-84b2-4ab6-89d9-983878e87549 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:23.563242 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ab8880d0-84b2-4ab6-89d9-983878e87549 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:23.570990 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ab8880d0-84b2-4ab6-89d9-983878e87549 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:23.571387 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ab8880d0-84b2-4ab6-89d9-983878e87549 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:23.572339 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ab8880d0-84b2-4ab6-89d9-983878e87549 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:23.572791 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ab8880d0-84b2-4ab6-89d9-983878e87549 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:23.614521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ab8880d0-84b2-4ab6-89d9-983878e87549 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:23.615203 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ab8880d0-84b2-4ab6-89d9-983878e87549 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:23.615639 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-ab8880d0-84b2-4ab6-89d9-983878e87549 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lazy-loading 'fault' on Instance uuid 8701ce7d-38d6-4383-9491-e2d4740a2f5f {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:20:23.669698 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ab8880d0-84b2-4ab6-89d9-983878e87549 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e05fbada6264cfb826ae4c93254de5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e8f35bd8844091accf4166f837f057', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:23.678495 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ab8880d0-84b2-4ab6-89d9-983878e87549 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 200 len: 1351 microversion: 2.1 time: 0.121470 Jun 22 10:20:23.679323 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 177/346] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:23 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 1351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:23.834387 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-332900a5-e9a4-4815-82f5-10712b434aed tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:23.835144 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-332900a5-e9a4-4815-82f5-10712b434aed tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:23.838429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:23.843441 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-332900a5-e9a4-4815-82f5-10712b434aed tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:23.843981 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-332900a5-e9a4-4815-82f5-10712b434aed tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:23.844767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-332900a5-e9a4-4815-82f5-10712b434aed tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:23.845311 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-332900a5-e9a4-4815-82f5-10712b434aed tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:23.912252 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-332900a5-e9a4-4815-82f5-10712b434aed tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:23.921122 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-332900a5-e9a4-4815-82f5-10712b434aed tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1265 microversion: 2.1 time: 0.090716 Jun 22 10:20:23.921646 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 170/347] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:23 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:24.170791 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6476ccbe-bbb3-4765-a7b4-8fc7041575ad tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:24.171436 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6476ccbe-bbb3-4765-a7b4-8fc7041575ad tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:24.177388 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6476ccbe-bbb3-4765-a7b4-8fc7041575ad tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:24.177827 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6476ccbe-bbb3-4765-a7b4-8fc7041575ad tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:24.178572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6476ccbe-bbb3-4765-a7b4-8fc7041575ad tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:24.178999 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6476ccbe-bbb3-4765-a7b4-8fc7041575ad tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:24.317093 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6476ccbe-bbb3-4765-a7b4-8fc7041575ad tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:24.324869 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6476ccbe-bbb3-4765-a7b4-8fc7041575ad tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.158253 Jun 22 10:20:24.325597 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 178/348] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:24 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:24.697631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fec81651-ebca-4fcf-90a8-40964f2e16a9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:24.698345 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-fec81651-ebca-4fcf-90a8-40964f2e16a9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:24.705441 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fec81651-ebca-4fcf-90a8-40964f2e16a9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:24.705977 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fec81651-ebca-4fcf-90a8-40964f2e16a9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:24.706833 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fec81651-ebca-4fcf-90a8-40964f2e16a9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:24.707419 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fec81651-ebca-4fcf-90a8-40964f2e16a9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:24.722109 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-fec81651-ebca-4fcf-90a8-40964f2e16a9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] HTTP exception thrown: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fec81651-ebca-4fcf-90a8-40964f2e16a9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Request method failure captured: Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f HTTP/1.1 Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisux3mVWZ8YWOrt6GoJMwyfccykkDs7N_ajkkhDUcBJxDhWQ2jUT1GehCz9lkEe5RPT0pxckVPi0eiZCRRASx-xiKBhsNDABJ_u5vmUtsNyX7e4PHxvYpUDXaf-5wBNoKO8De8921kBNqYf3WW67qS4tmP-s68qe9f8ALh7PXjgEPwsM Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: d5e8f35bd8844091accf4166f837f057 Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-DeleteServersTestJSON-953342270 Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:20:24.727442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:20:24.728992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d5e8f35bd8844091accf4166f837f057"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d5e8f35bd8844091accf4166f837f057", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d5e8f35bd8844091accf4166f837f057"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d5e8f35bd8844091accf4166f837f057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:20:24.728992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-DeleteServersTestJSON-953342270 Jun 22 10:20:24.728992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: d5e8f35bd8844091accf4166f837f057 Jun 22 10:20:24.728992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-DeleteServersTestJSON-953342270 Jun 22 10:20:24.728992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-DeleteServersTestJSON-953342270-project Jun 22 10:20:24.728992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:20:24.728992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:20:24.728992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 6e05fbada6264cfb826ae4c93254de5a Jun 22 10:20:24.728992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-DeleteServersTestJSON-953342270-project Jun 22 10:20:24.728992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:20:24.728992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:24.728992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '8701ce7d-38d6-4383-9491-e2d4740a2f5f'} Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:24.729798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:24.730890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:24.731952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fec81651-ebca-4fcf-90a8-40964f2e16a9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Returning 404 to user: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:24.731952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-fec81651-ebca-4fcf-90a8-40964f2e16a9 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 404 len: 111 microversion: 2.1 time: 0.035292 Jun 22 10:20:24.731952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 171/349] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:24 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:20:24.836037 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5e408ad9-512f-433f-a146-7693646ad79c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:24.837053 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5e408ad9-512f-433f-a146-7693646ad79c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:24.843107 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5e408ad9-512f-433f-a146-7693646ad79c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:24.843558 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5e408ad9-512f-433f-a146-7693646ad79c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:24.844360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5e408ad9-512f-433f-a146-7693646ad79c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:24.844799 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5e408ad9-512f-433f-a146-7693646ad79c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:24.857894 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-5e408ad9-512f-433f-a146-7693646ad79c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] HTTP exception thrown: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5e408ad9-512f-433f-a146-7693646ad79c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Request method failure captured: Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f/os-volume_attachments HTTP/1.1 Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisux3mVWZ8YWOrt6GoJMwyfccykkDs7N_ajkkhDUcBJxDhWQ2jUT1GehCz9lkEe5RPT0pxckVPi0eiZCRRASx-xiKBhsNDABJ_u5vmUtsNyX7e4PHxvYpUDXaf-5wBNoKO8De8921kBNqYf3WW67qS4tmP-s68qe9f8ALh7PXjgEPwsM Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: d5e8f35bd8844091accf4166f837f057 Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-DeleteServersTestJSON-953342270 Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:20:24.865586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:20:24.868789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d5e8f35bd8844091accf4166f837f057"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d5e8f35bd8844091accf4166f837f057", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d5e8f35bd8844091accf4166f837f057"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d5e8f35bd8844091accf4166f837f057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:20:24.868789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-DeleteServersTestJSON-953342270 Jun 22 10:20:24.868789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: d5e8f35bd8844091accf4166f837f057 Jun 22 10:20:24.868789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-DeleteServersTestJSON-953342270 Jun 22 10:20:24.868789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-DeleteServersTestJSON-953342270-project Jun 22 10:20:24.868789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:20:24.868789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:20:24.868789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 6e05fbada6264cfb826ae4c93254de5a Jun 22 10:20:24.868789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-DeleteServersTestJSON-953342270-project Jun 22 10:20:24.868789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:20:24.868789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:24.868789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'server_id': '8701ce7d-38d6-4383-9491-e2d4740a2f5f'} Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:24.869575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:24.870674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:20:24.871716 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5e408ad9-512f-433f-a146-7693646ad79c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Returning 404 to user: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:24.871716 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5e408ad9-512f-433f-a146-7693646ad79c tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035571 Jun 22 10:20:24.871716 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 179/350] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:20:24 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:20:24.938957 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-16362920-06ae-4390-9fea-f010a54cec56 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:24.940106 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-16362920-06ae-4390-9fea-f010a54cec56 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:24.953858 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-16362920-06ae-4390-9fea-f010a54cec56 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:24.953858 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-16362920-06ae-4390-9fea-f010a54cec56 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:24.953858 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-16362920-06ae-4390-9fea-f010a54cec56 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:24.953858 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-16362920-06ae-4390-9fea-f010a54cec56 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:25.025548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-16362920-06ae-4390-9fea-f010a54cec56 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:25.033594 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-16362920-06ae-4390-9fea-f010a54cec56 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1265 microversion: 2.1 time: 0.098609 Jun 22 10:20:25.034159 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 172/351] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:24 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:25.341999 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d481290d-648a-4610-9f2a-9c2b02834b57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:25.345453 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d481290d-648a-4610-9f2a-9c2b02834b57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:25.349200 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d481290d-648a-4610-9f2a-9c2b02834b57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:25.349653 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d481290d-648a-4610-9f2a-9c2b02834b57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:25.350428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d481290d-648a-4610-9f2a-9c2b02834b57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:25.350868 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d481290d-648a-4610-9f2a-9c2b02834b57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:25.484706 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d481290d-648a-4610-9f2a-9c2b02834b57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:25.493093 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d481290d-648a-4610-9f2a-9c2b02834b57 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.154981 Jun 22 10:20:25.493664 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 180/352] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:25 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:26.050333 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-48c98131-426c-471d-8ac7-a7f600d886cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:26.050939 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-48c98131-426c-471d-8ac7-a7f600d886cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:26.057790 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-48c98131-426c-471d-8ac7-a7f600d886cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:26.058177 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-48c98131-426c-471d-8ac7-a7f600d886cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:26.058945 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-48c98131-426c-471d-8ac7-a7f600d886cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:26.059381 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-48c98131-426c-471d-8ac7-a7f600d886cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:26.260741 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-48c98131-426c-471d-8ac7-a7f600d886cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:26.268802 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-48c98131-426c-471d-8ac7-a7f600d886cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1265 microversion: 2.1 time: 0.222258 Jun 22 10:20:26.270258 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 173/353] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:26 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:26.510001 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f2bf0304-3499-4716-a0cf-2a67cafc7009 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:26.511170 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f2bf0304-3499-4716-a0cf-2a67cafc7009 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:26.513370 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:26.518471 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f2bf0304-3499-4716-a0cf-2a67cafc7009 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:26.519948 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f2bf0304-3499-4716-a0cf-2a67cafc7009 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:26.519948 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f2bf0304-3499-4716-a0cf-2a67cafc7009 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:26.520203 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f2bf0304-3499-4716-a0cf-2a67cafc7009 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:26.654657 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f2bf0304-3499-4716-a0cf-2a67cafc7009 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:26.662769 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f2bf0304-3499-4716-a0cf-2a67cafc7009 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.157055 Jun 22 10:20:26.663585 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 181/354] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:26 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:27.290162 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a288d569-4429-4903-bc6c-bf775fd2bd75 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:27.290961 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a288d569-4429-4903-bc6c-bf775fd2bd75 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:27.297670 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a288d569-4429-4903-bc6c-bf775fd2bd75 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:27.298198 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a288d569-4429-4903-bc6c-bf775fd2bd75 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:27.299043 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a288d569-4429-4903-bc6c-bf775fd2bd75 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:27.299705 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a288d569-4429-4903-bc6c-bf775fd2bd75 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:27.368317 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a288d569-4429-4903-bc6c-bf775fd2bd75 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:27.377985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a288d569-4429-4903-bc6c-bf775fd2bd75 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1273 microversion: 2.1 time: 0.092798 Jun 22 10:20:27.378820 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 174/355] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:27 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:27.680015 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3532f3a9-89f4-451a-9e6c-dc639961a9fe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:27.680622 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3532f3a9-89f4-451a-9e6c-dc639961a9fe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:27.687046 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3532f3a9-89f4-451a-9e6c-dc639961a9fe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:27.687498 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3532f3a9-89f4-451a-9e6c-dc639961a9fe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:27.688296 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3532f3a9-89f4-451a-9e6c-dc639961a9fe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:27.688730 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3532f3a9-89f4-451a-9e6c-dc639961a9fe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:27.851843 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3532f3a9-89f4-451a-9e6c-dc639961a9fe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:27.861668 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3532f3a9-89f4-451a-9e6c-dc639961a9fe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.185992 Jun 22 10:20:27.862492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 182/356] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:27 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:28.372198 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9c47f38b-b743-408b-8392-f4938e7d87b2 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:28.372732 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9c47f38b-b743-408b-8392-f4938e7d87b2 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:28.379364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9c47f38b-b743-408b-8392-f4938e7d87b2 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:28.379803 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9c47f38b-b743-408b-8392-f4938e7d87b2 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:28.381116 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9c47f38b-b743-408b-8392-f4938e7d87b2 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:28.381538 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9c47f38b-b743-408b-8392-f4938e7d87b2 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:28.397220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7000c585-872e-481e-9bcd-b2628bef76f4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:28.398677 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7000c585-872e-481e-9bcd-b2628bef76f4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:28.401549 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-9c47f38b-b743-408b-8392-f4938e7d87b2 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] HTTP exception thrown: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9c47f38b-b743-408b-8392-f4938e7d87b2 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Request method failure captured: Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: DELETE /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f HTTP/1.1 Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisux3mVWZ8YWOrt6GoJMwyfccykkDs7N_ajkkhDUcBJxDhWQ2jUT1GehCz9lkEe5RPT0pxckVPi0eiZCRRASx-xiKBhsNDABJ_u5vmUtsNyX7e4PHxvYpUDXaf-5wBNoKO8De8921kBNqYf3WW67qS4tmP-s68qe9f8ALh7PXjgEPwsM Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: d5e8f35bd8844091accf4166f837f057 Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-DeleteServersTestJSON-953342270 Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:20:28.403305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:20:28.404444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d5e8f35bd8844091accf4166f837f057"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d5e8f35bd8844091accf4166f837f057", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d5e8f35bd8844091accf4166f837f057"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d5e8f35bd8844091accf4166f837f057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:20:28.404444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-DeleteServersTestJSON-953342270 Jun 22 10:20:28.404444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: d5e8f35bd8844091accf4166f837f057 Jun 22 10:20:28.404444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-DeleteServersTestJSON-953342270 Jun 22 10:20:28.404444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-DeleteServersTestJSON-953342270-project Jun 22 10:20:28.404444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:20:28.404444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:20:28.404444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 6e05fbada6264cfb826ae4c93254de5a Jun 22 10:20:28.404444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-DeleteServersTestJSON-953342270-project Jun 22 10:20:28.404444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:20:28.404444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:28.404444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '8701ce7d-38d6-4383-9491-e2d4740a2f5f'} Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:28.405570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:28.406667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:28.408002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9c47f38b-b743-408b-8392-f4938e7d87b2 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Returning 404 to user: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:28.408002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9c47f38b-b743-408b-8392-f4938e7d87b2 tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 404 len: 111 microversion: 2.1 time: 0.036345 Jun 22 10:20:28.408002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 175/357] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:20:28 2022] DELETE /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:20:28.411161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7000c585-872e-481e-9bcd-b2628bef76f4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:28.411861 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7000c585-872e-481e-9bcd-b2628bef76f4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:28.412902 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7000c585-872e-481e-9bcd-b2628bef76f4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:28.413678 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7000c585-872e-481e-9bcd-b2628bef76f4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:28.414429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ef64337b-f107-42c7-8809-5292974114ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:28.415048 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ef64337b-f107-42c7-8809-5292974114ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] [instance: 8701ce7d-38d6-4383-9491-e2d4740a2f5f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:28.422884 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef64337b-f107-42c7-8809-5292974114ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:28.424321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef64337b-f107-42c7-8809-5292974114ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:28.425146 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef64337b-f107-42c7-8809-5292974114ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:28.425590 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef64337b-f107-42c7-8809-5292974114ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:28.441508 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-ef64337b-f107-42c7-8809-5292974114ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] HTTP exception thrown: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ef64337b-f107-42c7-8809-5292974114ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Request method failure captured: Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f HTTP/1.1 Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisux3mVWZ8YWOrt6GoJMwyfccykkDs7N_ajkkhDUcBJxDhWQ2jUT1GehCz9lkEe5RPT0pxckVPi0eiZCRRASx-xiKBhsNDABJ_u5vmUtsNyX7e4PHxvYpUDXaf-5wBNoKO8De8921kBNqYf3WW67qS4tmP-s68qe9f8ALh7PXjgEPwsM Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: d5e8f35bd8844091accf4166f837f057 Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-DeleteServersTestJSON-953342270 Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:20:28.443830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:20:28.445298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d5e8f35bd8844091accf4166f837f057"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_d5e8f35bd8844091accf4166f837f057", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/d5e8f35bd8844091accf4166f837f057"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/d5e8f35bd8844091accf4166f837f057"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:20:28.445298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-DeleteServersTestJSON-953342270 Jun 22 10:20:28.445298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: d5e8f35bd8844091accf4166f837f057 Jun 22 10:20:28.445298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-DeleteServersTestJSON-953342270 Jun 22 10:20:28.445298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-DeleteServersTestJSON-953342270-project Jun 22 10:20:28.445298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:20:28.445298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:20:28.445298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 6e05fbada6264cfb826ae4c93254de5a Jun 22 10:20:28.445298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-DeleteServersTestJSON-953342270-project Jun 22 10:20:28.445298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:20:28.445298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:28.445298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '8701ce7d-38d6-4383-9491-e2d4740a2f5f'} Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:28.446097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. Jun 22 10:20:28.447492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:28.451708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ef64337b-f107-42c7-8809-5292974114ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] Returning 404 to user: Instance 8701ce7d-38d6-4383-9491-e2d4740a2f5f could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:28.451708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ef64337b-f107-42c7-8809-5292974114ab tempest-DeleteServersTestJSON-953342270 tempest-DeleteServersTestJSON-953342270-project] 10.222.0.46 "GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f" status: 404 len: 111 microversion: 2.1 time: 0.040736 Jun 22 10:20:28.455481 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 176/358] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:28 2022] GET /compute/v2.1/servers/8701ce7d-38d6-4383-9491-e2d4740a2f5f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:20:28.731612 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7000c585-872e-481e-9bcd-b2628bef76f4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:28.731612 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7000c585-872e-481e-9bcd-b2628bef76f4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.317492 Jun 22 10:20:28.731612 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 183/359] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:28 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:29.013155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f0ebccbb-519b-4f0a-809b-7408107422b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:29.013155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f0ebccbb-519b-4f0a-809b-7408107422b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:29.013155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f0ebccbb-519b-4f0a-809b-7408107422b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:29.013155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f0ebccbb-519b-4f0a-809b-7408107422b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:29.014448 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f0ebccbb-519b-4f0a-809b-7408107422b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:29.014448 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f0ebccbb-519b-4f0a-809b-7408107422b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:29.301660 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-e92bb60d-c97c-483d-b0cf-68ee844a230f req-3f2d5288-0db1-4f4a-985b-f9c1249fe956 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8e319e-213d-425f-9d28-c95848201859", "tag": "85e0a71d-2411-450b-8727-1ed9969b94ae"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:29.315788 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-e92bb60d-c97c-483d-b0cf-68ee844a230f req-3f2d5288-0db1-4f4a-985b-f9c1249fe956 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:29.316701 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-e92bb60d-c97c-483d-b0cf-68ee844a230f req-3f2d5288-0db1-4f4a-985b-f9c1249fe956 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:29.329661 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-e92bb60d-c97c-483d-b0cf-68ee844a230f req-3f2d5288-0db1-4f4a-985b-f9c1249fe956 service nova] Creating event network-changed:85e0a71d-2411-450b-8727-1ed9969b94ae for instance 6f8e319e-213d-425f-9d28-c95848201859 on hv-cinder-84327 Jun 22 10:20:29.334462 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-e92bb60d-c97c-483d-b0cf-68ee844a230f req-3f2d5288-0db1-4f4a-985b-f9c1249fe956 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035942 Jun 22 10:20:29.334946 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 184/360] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:29.391541 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f0ebccbb-519b-4f0a-809b-7408107422b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:29.401380 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f0ebccbb-519b-4f0a-809b-7408107422b4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.525625 Jun 22 10:20:29.401921 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 177/361] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:28 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:29.728595 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-dfa3f504-b7ea-4bae-a3f7-7bcd69a86a93 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:29.729481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-dfa3f504-b7ea-4bae-a3f7-7bcd69a86a93 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:29.735853 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dfa3f504-b7ea-4bae-a3f7-7bcd69a86a93 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:29.737676 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dfa3f504-b7ea-4bae-a3f7-7bcd69a86a93 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:29.738757 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dfa3f504-b7ea-4bae-a3f7-7bcd69a86a93 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:29.739507 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dfa3f504-b7ea-4bae-a3f7-7bcd69a86a93 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:29.952911 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-dfa3f504-b7ea-4bae-a3f7-7bcd69a86a93 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:29.960885 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-dfa3f504-b7ea-4bae-a3f7-7bcd69a86a93 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.237071 Jun 22 10:20:29.961466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 185/362] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:29 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:30.418909 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b339c0d4-24ce-4fed-ad7b-fee0c9ebaa1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:30.419430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b339c0d4-24ce-4fed-ad7b-fee0c9ebaa1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:30.421313 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:30.426459 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b339c0d4-24ce-4fed-ad7b-fee0c9ebaa1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:30.426896 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b339c0d4-24ce-4fed-ad7b-fee0c9ebaa1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:30.428255 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b339c0d4-24ce-4fed-ad7b-fee0c9ebaa1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:30.428685 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b339c0d4-24ce-4fed-ad7b-fee0c9ebaa1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:30.670304 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b339c0d4-24ce-4fed-ad7b-fee0c9ebaa1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:30.678407 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b339c0d4-24ce-4fed-ad7b-fee0c9ebaa1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.262774 Jun 22 10:20:30.687431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 178/363] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:30 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:30.978941 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e95f8111-9ba4-41da-b633-c2572510dd8e tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:30.979516 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e95f8111-9ba4-41da-b633-c2572510dd8e tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:30.985582 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e95f8111-9ba4-41da-b633-c2572510dd8e tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:30.986038 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e95f8111-9ba4-41da-b633-c2572510dd8e tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:30.986816 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e95f8111-9ba4-41da-b633-c2572510dd8e tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:30.987254 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e95f8111-9ba4-41da-b633-c2572510dd8e tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:31.142444 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e95f8111-9ba4-41da-b633-c2572510dd8e tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:31.152272 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e95f8111-9ba4-41da-b633-c2572510dd8e tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.177917 Jun 22 10:20:31.153119 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 186/364] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:30 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:31.698911 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2aa301c8-6629-425d-aec5-dfd697964606 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:31.699553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2aa301c8-6629-425d-aec5-dfd697964606 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:31.702347 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=10 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:31.709660 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2aa301c8-6629-425d-aec5-dfd697964606 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:31.710657 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2aa301c8-6629-425d-aec5-dfd697964606 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:31.711464 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2aa301c8-6629-425d-aec5-dfd697964606 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:31.712343 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2aa301c8-6629-425d-aec5-dfd697964606 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:31.884167 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2aa301c8-6629-425d-aec5-dfd697964606 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:31.893410 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2aa301c8-6629-425d-aec5-dfd697964606 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.201850 Jun 22 10:20:31.893990 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 179/365] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:31 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:32.171178 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6a9266aa-6b17-43fb-9374-f9b6c39fca4c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:32.171844 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6a9266aa-6b17-43fb-9374-f9b6c39fca4c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:32.178552 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6a9266aa-6b17-43fb-9374-f9b6c39fca4c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:32.178990 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6a9266aa-6b17-43fb-9374-f9b6c39fca4c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:32.179742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6a9266aa-6b17-43fb-9374-f9b6c39fca4c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:32.181606 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6a9266aa-6b17-43fb-9374-f9b6c39fca4c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:32.342392 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6a9266aa-6b17-43fb-9374-f9b6c39fca4c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:32.358877 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6a9266aa-6b17-43fb-9374-f9b6c39fca4c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.191408 Jun 22 10:20:32.359337 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 187/366] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:32 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:32.909407 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b6140028-280a-4e44-b6b0-a569244e8936 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:32.909970 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b6140028-280a-4e44-b6b0-a569244e8936 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:32.916745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b6140028-280a-4e44-b6b0-a569244e8936 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:32.917212 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b6140028-280a-4e44-b6b0-a569244e8936 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:32.918047 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b6140028-280a-4e44-b6b0-a569244e8936 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:32.918479 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b6140028-280a-4e44-b6b0-a569244e8936 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:32.922484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:33.058368 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b6140028-280a-4e44-b6b0-a569244e8936 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:33.066429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b6140028-280a-4e44-b6b0-a569244e8936 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.160814 Jun 22 10:20:33.077649 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 180/367] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:32 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:33.375958 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-067966e9-eb99-424b-abf5-f1de828add71 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:33.376558 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-067966e9-eb99-424b-abf5-f1de828add71 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:33.382828 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-067966e9-eb99-424b-abf5-f1de828add71 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:33.383271 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-067966e9-eb99-424b-abf5-f1de828add71 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:33.384052 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-067966e9-eb99-424b-abf5-f1de828add71 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:33.384456 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-067966e9-eb99-424b-abf5-f1de828add71 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:33.514096 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-067966e9-eb99-424b-abf5-f1de828add71 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:33.521854 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-067966e9-eb99-424b-abf5-f1de828add71 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.150117 Jun 22 10:20:33.522423 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 188/368] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:33 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:34.085294 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c7cf020a-5efd-4234-b8c9-33df6c728ba8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:34.085919 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c7cf020a-5efd-4234-b8c9-33df6c728ba8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:34.092617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c7cf020a-5efd-4234-b8c9-33df6c728ba8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:34.093109 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c7cf020a-5efd-4234-b8c9-33df6c728ba8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:34.097894 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c7cf020a-5efd-4234-b8c9-33df6c728ba8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:34.097894 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c7cf020a-5efd-4234-b8c9-33df6c728ba8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:34.226345 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c7cf020a-5efd-4234-b8c9-33df6c728ba8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:34.234368 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c7cf020a-5efd-4234-b8c9-33df6c728ba8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.153185 Jun 22 10:20:34.234932 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 181/369] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:34 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:34.539887 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7e401505-259d-468f-a40f-05c6b21c2d4f tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:34.540488 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7e401505-259d-468f-a40f-05c6b21c2d4f tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:34.546808 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7e401505-259d-468f-a40f-05c6b21c2d4f tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:34.547239 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7e401505-259d-468f-a40f-05c6b21c2d4f tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:34.548023 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7e401505-259d-468f-a40f-05c6b21c2d4f tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:34.548452 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7e401505-259d-468f-a40f-05c6b21c2d4f tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:34.684737 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7e401505-259d-468f-a40f-05c6b21c2d4f tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:34.692607 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7e401505-259d-468f-a40f-05c6b21c2d4f tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.157483 Jun 22 10:20:34.694675 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 189/370] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:34 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:35.251643 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-23c2b184-d876-44bb-ba8e-7bfd036a8b85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:35.252294 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-23c2b184-d876-44bb-ba8e-7bfd036a8b85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:35.258515 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-23c2b184-d876-44bb-ba8e-7bfd036a8b85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:35.259165 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-23c2b184-d876-44bb-ba8e-7bfd036a8b85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:35.259936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-23c2b184-d876-44bb-ba8e-7bfd036a8b85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:35.260371 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-23c2b184-d876-44bb-ba8e-7bfd036a8b85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:35.399248 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-23c2b184-d876-44bb-ba8e-7bfd036a8b85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:35.406743 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-23c2b184-d876-44bb-ba8e-7bfd036a8b85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.159240 Jun 22 10:20:35.407354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 182/371] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:35 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:35.711792 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5484339f-0177-4532-acf1-052bf9f3eb3c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:35.712405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5484339f-0177-4532-acf1-052bf9f3eb3c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:35.719351 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5484339f-0177-4532-acf1-052bf9f3eb3c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:35.719806 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5484339f-0177-4532-acf1-052bf9f3eb3c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:35.720591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5484339f-0177-4532-acf1-052bf9f3eb3c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:35.721058 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5484339f-0177-4532-acf1-052bf9f3eb3c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:35.869057 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5484339f-0177-4532-acf1-052bf9f3eb3c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:35.881657 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5484339f-0177-4532-acf1-052bf9f3eb3c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.173707 Jun 22 10:20:35.882751 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 190/372] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:35 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:36.424447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b8c72065-37b9-4eea-bad6-969c2b9d204e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:36.425094 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b8c72065-37b9-4eea-bad6-969c2b9d204e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:36.432679 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b8c72065-37b9-4eea-bad6-969c2b9d204e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:36.436724 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b8c72065-37b9-4eea-bad6-969c2b9d204e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:36.436724 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b8c72065-37b9-4eea-bad6-969c2b9d204e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:36.436724 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b8c72065-37b9-4eea-bad6-969c2b9d204e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:36.584969 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b8c72065-37b9-4eea-bad6-969c2b9d204e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:36.593377 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b8c72065-37b9-4eea-bad6-969c2b9d204e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.172606 Jun 22 10:20:36.594278 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 183/373] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:36 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:36.899706 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5b093343-7744-4742-b85b-ee3f24d94638 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:36.900307 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5b093343-7744-4742-b85b-ee3f24d94638 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:36.908555 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5b093343-7744-4742-b85b-ee3f24d94638 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:36.909276 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5b093343-7744-4742-b85b-ee3f24d94638 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:36.910081 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5b093343-7744-4742-b85b-ee3f24d94638 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:36.913206 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5b093343-7744-4742-b85b-ee3f24d94638 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:37.074624 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5b093343-7744-4742-b85b-ee3f24d94638 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:37.082489 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5b093343-7744-4742-b85b-ee3f24d94638 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.186637 Jun 22 10:20:37.083075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 191/374] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:36 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:37.610293 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-239ce2b8-fd87-4c71-ada6-4f51646bd93f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:37.610902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-239ce2b8-fd87-4c71-ada6-4f51646bd93f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:37.620360 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-239ce2b8-fd87-4c71-ada6-4f51646bd93f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:37.620360 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-239ce2b8-fd87-4c71-ada6-4f51646bd93f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:37.620360 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-239ce2b8-fd87-4c71-ada6-4f51646bd93f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:37.620360 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-239ce2b8-fd87-4c71-ada6-4f51646bd93f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:37.757924 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-239ce2b8-fd87-4c71-ada6-4f51646bd93f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:37.765646 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-239ce2b8-fd87-4c71-ada6-4f51646bd93f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.159128 Jun 22 10:20:37.766208 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 184/375] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:37 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:38.090507 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-25319e31-57aa-4c56-8f61-a8aed4287818 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] Calling method '.version_select at 0x7f021fe30280>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:38.104119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-91abcea5-8adc-4deb-a4fe-ded335ca25e5 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:38.104781 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-91abcea5-8adc-4deb-a4fe-ded335ca25e5 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:38.120427 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-91abcea5-8adc-4deb-a4fe-ded335ca25e5 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:38.124220 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-91abcea5-8adc-4deb-a4fe-ded335ca25e5 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:38.128529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-91abcea5-8adc-4deb-a4fe-ded335ca25e5 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:38.129025 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-91abcea5-8adc-4deb-a4fe-ded335ca25e5 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:38.172665 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-25319e31-57aa-4c56-8f61-a8aed4287818 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/36e1ac04-70c7-4eeb-ab77-45d5b5756fff" status: 200 len: 350 microversion: 2.1 time: 0.085883 Jun 22 10:20:38.173522 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 192/376] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:38 2022] GET /compute/v2.1/os-volumes/36e1ac04-70c7-4eeb-ab77-45d5b5756fff => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:38.278137 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-91abcea5-8adc-4deb-a4fe-ded335ca25e5 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:38.286141 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-91abcea5-8adc-4deb-a4fe-ded335ca25e5 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.190844 Jun 22 10:20:38.292541 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 185/377] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:38 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:38.784388 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-af5ecd2b-6e0b-44ce-a07b-b33124b5a195 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:38.785089 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-af5ecd2b-6e0b-44ce-a07b-b33124b5a195 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:38.792158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-af5ecd2b-6e0b-44ce-a07b-b33124b5a195 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:38.793234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-af5ecd2b-6e0b-44ce-a07b-b33124b5a195 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:38.794594 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-af5ecd2b-6e0b-44ce-a07b-b33124b5a195 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:38.795097 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-af5ecd2b-6e0b-44ce-a07b-b33124b5a195 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:38.982027 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-af5ecd2b-6e0b-44ce-a07b-b33124b5a195 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:38.994923 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-af5ecd2b-6e0b-44ce-a07b-b33124b5a195 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.215672 Jun 22 10:20:38.995853 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 193/378] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:38 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:39.306140 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bbe58026-2662-4b45-bcea-d852a302a116 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:39.306751 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bbe58026-2662-4b45-bcea-d852a302a116 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:39.313101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bbe58026-2662-4b45-bcea-d852a302a116 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:39.313553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bbe58026-2662-4b45-bcea-d852a302a116 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:39.314316 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bbe58026-2662-4b45-bcea-d852a302a116 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:39.314744 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bbe58026-2662-4b45-bcea-d852a302a116 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:39.463017 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bbe58026-2662-4b45-bcea-d852a302a116 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:39.471497 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bbe58026-2662-4b45-bcea-d852a302a116 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.170204 Jun 22 10:20:39.472079 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 186/379] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:39 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:40.019671 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-01c8d146-6a72-4796-ac64-0d489b734ac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:40.020272 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-01c8d146-6a72-4796-ac64-0d489b734ac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:40.026985 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-01c8d146-6a72-4796-ac64-0d489b734ac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:40.027439 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-01c8d146-6a72-4796-ac64-0d489b734ac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:40.028214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-01c8d146-6a72-4796-ac64-0d489b734ac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:40.028656 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-01c8d146-6a72-4796-ac64-0d489b734ac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:40.166583 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-01c8d146-6a72-4796-ac64-0d489b734ac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:40.171134 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:40.175782 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-01c8d146-6a72-4796-ac64-0d489b734ac4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.160205 Jun 22 10:20:40.176548 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 194/380] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:40 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:40.489483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c917a3f6-f0e4-486f-abf6-bfd3796b043c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:40.490271 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c917a3f6-f0e4-486f-abf6-bfd3796b043c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:40.498373 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c917a3f6-f0e4-486f-abf6-bfd3796b043c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:40.498824 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c917a3f6-f0e4-486f-abf6-bfd3796b043c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:40.500939 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c917a3f6-f0e4-486f-abf6-bfd3796b043c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:40.500939 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c917a3f6-f0e4-486f-abf6-bfd3796b043c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:40.655363 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c917a3f6-f0e4-486f-abf6-bfd3796b043c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:40.668053 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c917a3f6-f0e4-486f-abf6-bfd3796b043c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.177607 Jun 22 10:20:40.668053 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 187/381] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:40 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:40.981073 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-aa27a6c7-768c-4ca9-b0cc-a2f892c0b9a4 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] Calling method '.version_select at 0x7f021fe30ee0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:41.027997 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-aa27a6c7-768c-4ca9-b0cc-a2f892c0b9a4 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/13dc23ef-5f82-4d89-af9e-4c671ba1d4d8" status: 200 len: 350 microversion: 2.1 time: 0.050650 Jun 22 10:20:41.028557 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 195/382] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:40 2022] GET /compute/v2.1/os-volumes/13dc23ef-5f82-4d89-af9e-4c671ba1d4d8 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:41.192900 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-620c676b-bd91-4268-a086-ff20c7c8739a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:41.193423 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-620c676b-bd91-4268-a086-ff20c7c8739a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:41.199993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-620c676b-bd91-4268-a086-ff20c7c8739a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:41.200444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-620c676b-bd91-4268-a086-ff20c7c8739a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:41.201242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-620c676b-bd91-4268-a086-ff20c7c8739a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:41.201681 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-620c676b-bd91-4268-a086-ff20c7c8739a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:41.330849 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-620c676b-bd91-4268-a086-ff20c7c8739a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:41.338869 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-620c676b-bd91-4268-a086-ff20c7c8739a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.149939 Jun 22 10:20:41.339432 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 188/383] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:41 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:41.682020 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-682767e4-23a3-4ea8-ac71-f1a889a01b22 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:41.683728 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-682767e4-23a3-4ea8-ac71-f1a889a01b22 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:41.692431 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-682767e4-23a3-4ea8-ac71-f1a889a01b22 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:41.692904 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-682767e4-23a3-4ea8-ac71-f1a889a01b22 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:41.693689 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-682767e4-23a3-4ea8-ac71-f1a889a01b22 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:41.694166 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-682767e4-23a3-4ea8-ac71-f1a889a01b22 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:41.812293 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-1238f27e-a50b-4ad9-bf92-d5594e613f75 req-0dad53b0-9d24-45f0-bb23-299d3c60c9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8e319e-213d-425f-9d28-c95848201859", "name": "network-vif-plugged", "status": "completed", "tag": "85e0a71d-2411-450b-8727-1ed9969b94ae"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:41.824305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-1238f27e-a50b-4ad9-bf92-d5594e613f75 req-0dad53b0-9d24-45f0-bb23-299d3c60c9a6 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:41.824936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-1238f27e-a50b-4ad9-bf92-d5594e613f75 req-0dad53b0-9d24-45f0-bb23-299d3c60c9a6 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:41.833987 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-682767e4-23a3-4ea8-ac71-f1a889a01b22 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:41.837820 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-1238f27e-a50b-4ad9-bf92-d5594e613f75 req-0dad53b0-9d24-45f0-bb23-299d3c60c9a6 service nova] Creating event network-vif-plugged:85e0a71d-2411-450b-8727-1ed9969b94ae for instance 6f8e319e-213d-425f-9d28-c95848201859 on hv-cinder-84327 Jun 22 10:20:41.843308 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-682767e4-23a3-4ea8-ac71-f1a889a01b22 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.165532 Jun 22 10:20:41.844092 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 196/384] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:41 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:41.844239 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-1238f27e-a50b-4ad9-bf92-d5594e613f75 req-0dad53b0-9d24-45f0-bb23-299d3c60c9a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037759 Jun 22 10:20:41.845322 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 189/385] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:42.357287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9efd87f1-9915-4f6a-a416-9353d0b7252a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:42.357887 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9efd87f1-9915-4f6a-a416-9353d0b7252a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:42.364109 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9efd87f1-9915-4f6a-a416-9353d0b7252a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:42.364554 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9efd87f1-9915-4f6a-a416-9353d0b7252a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:42.365342 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9efd87f1-9915-4f6a-a416-9353d0b7252a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:42.365771 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9efd87f1-9915-4f6a-a416-9353d0b7252a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:42.497900 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9efd87f1-9915-4f6a-a416-9353d0b7252a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:42.505473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9efd87f1-9915-4f6a-a416-9353d0b7252a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1522 microversion: 2.1 time: 0.152729 Jun 22 10:20:42.506038 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 197/386] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:42 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:42.861718 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-79805c4a-139b-46a4-bffb-d7afdcf61fb7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:42.862416 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-79805c4a-139b-46a4-bffb-d7afdcf61fb7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:42.870541 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-79805c4a-139b-46a4-bffb-d7afdcf61fb7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:42.872494 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-79805c4a-139b-46a4-bffb-d7afdcf61fb7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:42.873661 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-79805c4a-139b-46a4-bffb-d7afdcf61fb7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:42.874115 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-79805c4a-139b-46a4-bffb-d7afdcf61fb7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:43.017006 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-79805c4a-139b-46a4-bffb-d7afdcf61fb7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:43.024665 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-79805c4a-139b-46a4-bffb-d7afdcf61fb7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.167896 Jun 22 10:20:43.025253 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 190/387] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:42 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:43.522627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b06e2642-1989-4205-86a8-f778ec451c49 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:43.523641 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b06e2642-1989-4205-86a8-f778ec451c49 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:43.529920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b06e2642-1989-4205-86a8-f778ec451c49 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:43.530372 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b06e2642-1989-4205-86a8-f778ec451c49 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:43.531138 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b06e2642-1989-4205-86a8-f778ec451c49 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:43.531576 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b06e2642-1989-4205-86a8-f778ec451c49 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:43.665207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b06e2642-1989-4205-86a8-f778ec451c49 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:43.673031 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b06e2642-1989-4205-86a8-f778ec451c49 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1502 microversion: 2.1 time: 0.154510 Jun 22 10:20:43.673638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 198/388] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:43 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:43.689360 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a5ff65f1-6a6b-4073-bc66-e382e83d8a35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:43.690036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a5ff65f1-6a6b-4073-bc66-e382e83d8a35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:43.696117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a5ff65f1-6a6b-4073-bc66-e382e83d8a35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:43.696561 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a5ff65f1-6a6b-4073-bc66-e382e83d8a35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:43.697357 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a5ff65f1-6a6b-4073-bc66-e382e83d8a35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:43.697817 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a5ff65f1-6a6b-4073-bc66-e382e83d8a35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:43.746678 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3a244900-2ba6-48e3-a5f5-59f4b115c7bb tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] Calling method '.version_select at 0x7f021fed9160>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:43.797007 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3a244900-2ba6-48e3-a5f5-59f4b115c7bb tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/29dca431-6602-40d5-8346-10ad2b0d21db" status: 200 len: 351 microversion: 2.1 time: 0.053996 Jun 22 10:20:43.797581 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 199/389] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:43 2022] GET /compute/v2.1/os-volumes/29dca431-6602-40d5-8346-10ad2b0d21db => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:43.808441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-23bc9698-5b2c-4b8d-b5c6-3d02e2e47ea2 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] Calling method '.version_select at 0x7f021fe308b0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:43.834145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a5ff65f1-6a6b-4073-bc66-e382e83d8a35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:43.843177 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a5ff65f1-6a6b-4073-bc66-e382e83d8a35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1516 microversion: 2.1 time: 0.158037 Jun 22 10:20:43.843614 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 191/390] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:43 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:43.888678 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-23bc9698-5b2c-4b8d-b5c6-3d02e2e47ea2 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.083803 Jun 22 10:20:43.889292 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 200/391] 10.222.0.46 () {58 vars in 1133 bytes} [Wed Jun 22 10:20:43 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:43.901713 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1a417d0f-9a9f-4f19-ad58-8827be8aaee5 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] Calling method '.version_select at 0x7f021ff7bdc0>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:43.993744 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1a417d0f-9a9f-4f19-ad58-8827be8aaee5 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095738 Jun 22 10:20:43.994312 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 192/392] 10.222.0.46 () {58 vars in 1148 bytes} [Wed Jun 22 10:20:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:44.005909 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b8da9c44-b9e8-4a7c-83c3-5f850f25bb1f tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] Calling method '.version_select at 0x7f022e12b040>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:44.042439 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-afd9cb4e-fb25-46b1-89d7-13ced71a6030 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:44.043062 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-afd9cb4e-fb25-46b1-89d7-13ced71a6030 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:44.050196 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-afd9cb4e-fb25-46b1-89d7-13ced71a6030 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:44.050641 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-afd9cb4e-fb25-46b1-89d7-13ced71a6030 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:44.051501 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-afd9cb4e-fb25-46b1-89d7-13ced71a6030 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:44.051936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-afd9cb4e-fb25-46b1-89d7-13ced71a6030 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:44.088784 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b8da9c44-b9e8-4a7c-83c3-5f850f25bb1f tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086320 Jun 22 10:20:44.089514 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 201/393] 10.222.0.46 () {58 vars in 1133 bytes} [Wed Jun 22 10:20:44 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:44.100517 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-03ebdbb5-e659-4b05-8928-76b690dc92bd tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] Calling method '.version_select at 0x7f021fe3b700>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:44.183280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-03ebdbb5-e659-4b05-8928-76b690dc92bd tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086399 Jun 22 10:20:44.183866 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 202/394] 10.222.0.46 () {58 vars in 1166 bytes} [Wed Jun 22 10:20:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:44.196840 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-29b35ed0-3392-4297-83ee-e02397cea046 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] Calling method '.version_select at 0x7f022c063b80>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:44.199939 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-afd9cb4e-fb25-46b1-89d7-13ced71a6030 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:44.207872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-afd9cb4e-fb25-46b1-89d7-13ced71a6030 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.170195 Jun 22 10:20:44.208433 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 193/395] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:44 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:44.279338 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-29b35ed0-3392-4297-83ee-e02397cea046 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086263 Jun 22 10:20:44.285029 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 203/396] 10.222.0.46 () {58 vars in 1169 bytes} [Wed Jun 22 10:20:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:44.291682 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bbd8b0e8-71ac-46fb-aeb0-3e06fd1daee3 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] Calling method '.version_select at 0x7f022c030280>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:44.375502 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bbd8b0e8-71ac-46fb-aeb0-3e06fd1daee3 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087384 Jun 22 10:20:44.376200 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 194/397] 10.222.0.46 () {58 vars in 1154 bytes} [Wed Jun 22 10:20:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:44.388515 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f9af872d-d18a-476f-99ce-8128cbf06336 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] Calling method '.version_select at 0x7f021fe305e0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:44.481084 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f9af872d-d18a-476f-99ce-8128cbf06336 tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096238 Jun 22 10:20:44.481954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 204/398] 10.222.0.46 () {58 vars in 1187 bytes} [Wed Jun 22 10:20:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:44.493591 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b2c21537-3148-4f42-84c9-99e12aa572dc tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] Calling method '.version_select at 0x7f021fdda670>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:44.575102 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b2c21537-3148-4f42-84c9-99e12aa572dc tempest-VolumesTestJSON-837585880 tempest-VolumesTestJSON-837585880-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.085674 Jun 22 10:20:44.575767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 195/399] 10.222.0.46 () {58 vars in 1154 bytes} [Wed Jun 22 10:20:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:45.225387 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4d4abc47-69ac-43fb-81b1-506d53e8b756 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:45.225920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4d4abc47-69ac-43fb-81b1-506d53e8b756 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:45.232560 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4d4abc47-69ac-43fb-81b1-506d53e8b756 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:45.233049 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4d4abc47-69ac-43fb-81b1-506d53e8b756 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:45.233845 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4d4abc47-69ac-43fb-81b1-506d53e8b756 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:45.234282 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4d4abc47-69ac-43fb-81b1-506d53e8b756 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:45.362459 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4d4abc47-69ac-43fb-81b1-506d53e8b756 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:45.369943 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4d4abc47-69ac-43fb-81b1-506d53e8b756 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.148578 Jun 22 10:20:45.370509 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 205/400] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:45 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:46.388272 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-75095dd8-c6a5-47c7-b87f-ee0e0322ba6c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:46.388938 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-75095dd8-c6a5-47c7-b87f-ee0e0322ba6c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:46.396098 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-75095dd8-c6a5-47c7-b87f-ee0e0322ba6c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:46.396543 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-75095dd8-c6a5-47c7-b87f-ee0e0322ba6c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:46.397337 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-75095dd8-c6a5-47c7-b87f-ee0e0322ba6c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:46.397775 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-75095dd8-c6a5-47c7-b87f-ee0e0322ba6c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:46.527090 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-75095dd8-c6a5-47c7-b87f-ee0e0322ba6c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:46.534948 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-75095dd8-c6a5-47c7-b87f-ee0e0322ba6c tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1313 microversion: 2.1 time: 0.150779 Jun 22 10:20:46.535503 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 196/401] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:46 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:47.551530 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b0ef0ee5-7125-499e-bd89-34731af8d9c4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:47.552149 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b0ef0ee5-7125-499e-bd89-34731af8d9c4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:47.559178 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b0ef0ee5-7125-499e-bd89-34731af8d9c4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:47.559465 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b0ef0ee5-7125-499e-bd89-34731af8d9c4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:47.560232 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b0ef0ee5-7125-499e-bd89-34731af8d9c4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:47.560675 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b0ef0ee5-7125-499e-bd89-34731af8d9c4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:47.692772 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b0ef0ee5-7125-499e-bd89-34731af8d9c4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:47.700270 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b0ef0ee5-7125-499e-bd89-34731af8d9c4 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1497 microversion: 2.1 time: 0.152621 Jun 22 10:20:47.700931 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 206/402] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:47 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:51.037211 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2ec2d15f-2c08-4bee-900d-719f39d7f4a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:51.038254 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2ec2d15f-2c08-4bee-900d-719f39d7f4a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:51.045686 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2ec2d15f-2c08-4bee-900d-719f39d7f4a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.046143 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2ec2d15f-2c08-4bee-900d-719f39d7f4a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.046924 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2ec2d15f-2c08-4bee-900d-719f39d7f4a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.047364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2ec2d15f-2c08-4bee-900d-719f39d7f4a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.073195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-2ec2d15f-2c08-4bee-900d-719f39d7f4a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lazy-loading 'flavor' on Instance uuid 398fb416-b4c6-4b43-80be-683e1a41721b {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:20:51.186729 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ba224ac6-cd14-4fa8-ae44-45e3e005a674 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:51.187511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ba224ac6-cd14-4fa8-ae44-45e3e005a674 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:51.193655 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ba224ac6-cd14-4fa8-ae44-45e3e005a674 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.194193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ba224ac6-cd14-4fa8-ae44-45e3e005a674 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.194858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ba224ac6-cd14-4fa8-ae44-45e3e005a674 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.195292 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ba224ac6-cd14-4fa8-ae44-45e3e005a674 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.223881 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ba224ac6-cd14-4fa8-ae44-45e3e005a674 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:20:51.445355 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2ec2d15f-2c08-4bee-900d-719f39d7f4a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "POST /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b/action" status: 200 len: 32 microversion: 2.1 time: 0.404010 Jun 22 10:20:51.445355 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 197/403] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:20:51 2022] POST /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b/action => generated 32 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:20:51.455934 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-febbce15-fb77-416c-ab37-3a6ab0053a6f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:51.456660 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-febbce15-fb77-416c-ab37-3a6ab0053a6f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:51.465628 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-febbce15-fb77-416c-ab37-3a6ab0053a6f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.466072 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-febbce15-fb77-416c-ab37-3a6ab0053a6f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.467200 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-febbce15-fb77-416c-ab37-3a6ab0053a6f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.467506 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-febbce15-fb77-416c-ab37-3a6ab0053a6f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.487442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:51.536324 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ba224ac6-cd14-4fa8-ae44-45e3e005a674 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 204 len: 0 microversion: 2.1 time: 0.353090 Jun 22 10:20:51.537161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 207/404] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:20:51 2022] DELETE /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 10:20:51.545964 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5d7ab9b0-d423-4c79-8f1f-56ac8a2a996a tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:51.546667 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5d7ab9b0-d423-4c79-8f1f-56ac8a2a996a tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:51.553374 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5d7ab9b0-d423-4c79-8f1f-56ac8a2a996a tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.553893 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5d7ab9b0-d423-4c79-8f1f-56ac8a2a996a tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.554701 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5d7ab9b0-d423-4c79-8f1f-56ac8a2a996a tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.555174 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5d7ab9b0-d423-4c79-8f1f-56ac8a2a996a tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.635717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-febbce15-fb77-416c-ab37-3a6ab0053a6f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:51.643214 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-febbce15-fb77-416c-ab37-3a6ab0053a6f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.193032 Jun 22 10:20:51.643782 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 198/405] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:51 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:51.720067 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5d7ab9b0-d423-4c79-8f1f-56ac8a2a996a tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:51.720067 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5d7ab9b0-d423-4c79-8f1f-56ac8a2a996a tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1503 microversion: 2.1 time: 0.177561 Jun 22 10:20:51.720067 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 208/406] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:51 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:52.661540 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f26ecac8-ea09-4092-89ff-15b0a1b0c2f8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:52.662070 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f26ecac8-ea09-4092-89ff-15b0a1b0c2f8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:52.668994 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f26ecac8-ea09-4092-89ff-15b0a1b0c2f8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.669441 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f26ecac8-ea09-4092-89ff-15b0a1b0c2f8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.670676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f26ecac8-ea09-4092-89ff-15b0a1b0c2f8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.670676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f26ecac8-ea09-4092-89ff-15b0a1b0c2f8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.736443 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-93f5ee52-4108-485c-a5e3-751547d34ae9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:52.737159 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-93f5ee52-4108-485c-a5e3-751547d34ae9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:52.744009 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-93f5ee52-4108-485c-a5e3-751547d34ae9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.744566 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-93f5ee52-4108-485c-a5e3-751547d34ae9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.745533 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-93f5ee52-4108-485c-a5e3-751547d34ae9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.746041 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-93f5ee52-4108-485c-a5e3-751547d34ae9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.851565 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f26ecac8-ea09-4092-89ff-15b0a1b0c2f8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:52.863520 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f26ecac8-ea09-4092-89ff-15b0a1b0c2f8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.206028 Jun 22 10:20:52.864274 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 199/407] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:52 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:52.915379 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-93f5ee52-4108-485c-a5e3-751547d34ae9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:52.923396 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-93f5ee52-4108-485c-a5e3-751547d34ae9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1503 microversion: 2.1 time: 0.190999 Jun 22 10:20:52.924067 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 209/408] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:52 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:53.881720 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6712df0c-004e-44e0-9ffe-ce66baabc798 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:53.882447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6712df0c-004e-44e0-9ffe-ce66baabc798 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:53.889879 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6712df0c-004e-44e0-9ffe-ce66baabc798 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:53.890458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6712df0c-004e-44e0-9ffe-ce66baabc798 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:53.891440 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6712df0c-004e-44e0-9ffe-ce66baabc798 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:53.892025 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6712df0c-004e-44e0-9ffe-ce66baabc798 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:53.944076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f8197cd3-421c-4fce-a260-42d8db5be0da tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:53.944538 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f8197cd3-421c-4fce-a260-42d8db5be0da tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:53.953601 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f8197cd3-421c-4fce-a260-42d8db5be0da tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:53.954294 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f8197cd3-421c-4fce-a260-42d8db5be0da tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:53.955276 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f8197cd3-421c-4fce-a260-42d8db5be0da tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:53.955859 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f8197cd3-421c-4fce-a260-42d8db5be0da tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:54.083144 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6712df0c-004e-44e0-9ffe-ce66baabc798 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:54.092980 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6712df0c-004e-44e0-9ffe-ce66baabc798 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.215677 Jun 22 10:20:54.093600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 200/409] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:53 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:54.135637 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f8197cd3-421c-4fce-a260-42d8db5be0da tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:54.143323 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f8197cd3-421c-4fce-a260-42d8db5be0da tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1503 microversion: 2.1 time: 0.205479 Jun 22 10:20:54.143899 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 210/410] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:53 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:54.402612 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-f0923b32-f2d7-451a-a667-8b7779af7201 req-7f977745-750c-4725-b05c-eb4e89a342fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8e319e-213d-425f-9d28-c95848201859", "name": "network-vif-deleted", "tag": "85e0a71d-2411-450b-8727-1ed9969b94ae"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:54.415984 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-f0923b32-f2d7-451a-a667-8b7779af7201 req-7f977745-750c-4725-b05c-eb4e89a342fd service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:54.416500 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-f0923b32-f2d7-451a-a667-8b7779af7201 req-7f977745-750c-4725-b05c-eb4e89a342fd service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:54.431268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-f0923b32-f2d7-451a-a667-8b7779af7201 req-7f977745-750c-4725-b05c-eb4e89a342fd service nova] Creating event network-vif-deleted:85e0a71d-2411-450b-8727-1ed9969b94ae for instance 6f8e319e-213d-425f-9d28-c95848201859 on hv-cinder-84327 Jun 22 10:20:54.437322 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-f0923b32-f2d7-451a-a667-8b7779af7201 req-7f977745-750c-4725-b05c-eb4e89a342fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044259 Jun 22 10:20:54.437920 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 201/411] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:55.110015 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4f7f3030-0149-4a1c-be62-b90fad12920c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:55.111189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4f7f3030-0149-4a1c-be62-b90fad12920c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:55.117859 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4f7f3030-0149-4a1c-be62-b90fad12920c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.118333 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4f7f3030-0149-4a1c-be62-b90fad12920c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.122509 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4f7f3030-0149-4a1c-be62-b90fad12920c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.122957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4f7f3030-0149-4a1c-be62-b90fad12920c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.161746 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-dd4615c7-2175-4ed4-a1cd-6c2951be51cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:55.162647 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-dd4615c7-2175-4ed4-a1cd-6c2951be51cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:55.165587 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=58 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:55.170912 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dd4615c7-2175-4ed4-a1cd-6c2951be51cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.171373 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dd4615c7-2175-4ed4-a1cd-6c2951be51cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.172785 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dd4615c7-2175-4ed4-a1cd-6c2951be51cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.172940 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dd4615c7-2175-4ed4-a1cd-6c2951be51cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.216574 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dd4615c7-2175-4ed4-a1cd-6c2951be51cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.217050 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dd4615c7-2175-4ed4-a1cd-6c2951be51cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.217500 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-dd4615c7-2175-4ed4-a1cd-6c2951be51cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lazy-loading 'fault' on Instance uuid 6f8e319e-213d-425f-9d28-c95848201859 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:20:55.279679 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-dd4615c7-2175-4ed4-a1cd-6c2951be51cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:55.305453 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-dd4615c7-2175-4ed4-a1cd-6c2951be51cc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 200 len: 1303 microversion: 2.1 time: 0.146693 Jun 22 10:20:55.316949 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4f7f3030-0149-4a1c-be62-b90fad12920c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:55.321837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 202/412] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:55 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 1303 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:55.326579 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4f7f3030-0149-4a1c-be62-b90fad12920c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.220914 Jun 22 10:20:55.336766 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 211/413] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:55 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:56.335694 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1dca64dd-e781-45c2-8786-832cd5d77104 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:56.335694 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1dca64dd-e781-45c2-8786-832cd5d77104 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: 6f8e319e-213d-425f-9d28-c95848201859] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:56.335694 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1dca64dd-e781-45c2-8786-832cd5d77104 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:56.335694 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1dca64dd-e781-45c2-8786-832cd5d77104 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:56.336381 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1dca64dd-e781-45c2-8786-832cd5d77104 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:56.336381 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1dca64dd-e781-45c2-8786-832cd5d77104 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:56.343784 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-69e60f44-9daa-4085-b7eb-ba9c9f654bba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:56.345021 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-69e60f44-9daa-4085-b7eb-ba9c9f654bba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:56.350132 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-1dca64dd-e781-45c2-8786-832cd5d77104 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] HTTP exception thrown: Instance 6f8e319e-213d-425f-9d28-c95848201859 could not be found. Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1dca64dd-e781-45c2-8786-832cd5d77104 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Request method failure captured: Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 HTTP/1.1 Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisuzghJ3GchlQM-y_1ZKxaTCL2sH9-CPIMZC72dEKm0Q40wvSsX7mqhZcS1TKCSt7pY1xcWmJrjILQUwB3D6J_DHIc_PB9jxfQkTNZv0H-Aqa4Fu3hvT7gTCBE1Xi89jcNTSeUlum-Ny35JYrZxTiCXyNR-pagr_EcjUgxPVqRB0UFwY Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 9e06f1a9b667414b8d663033c7053b76 Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-VolumesActionsTest-1236945761 Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:20:56.351908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:20:56.353465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9e06f1a9b667414b8d663033c7053b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9e06f1a9b667414b8d663033c7053b76", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9e06f1a9b667414b8d663033c7053b76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9e06f1a9b667414b8d663033c7053b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:20:56.353465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-VolumesActionsTest-1236945761 Jun 22 10:20:56.353465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 9e06f1a9b667414b8d663033c7053b76 Jun 22 10:20:56.353465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-VolumesActionsTest-1236945761 Jun 22 10:20:56.353465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-VolumesActionsTest-1236945761-project Jun 22 10:20:56.353465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:20:56.353465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:20:56.353465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: c2e02737f0cc423d95db9c3324f7215e Jun 22 10:20:56.353465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-VolumesActionsTest-1236945761-project Jun 22 10:20:56.353465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:20:56.353465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 6f8e319e-213d-425f-9d28-c95848201859 could not be found. Jun 22 10:20:56.353465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '6f8e319e-213d-425f-9d28-c95848201859'} Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8e319e-213d-425f-9d28-c95848201859 could not be found. Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:56.357570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8e319e-213d-425f-9d28-c95848201859 could not be found. Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8e319e-213d-425f-9d28-c95848201859 could not be found. Jun 22 10:20:56.358998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:20:56.360545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1dca64dd-e781-45c2-8786-832cd5d77104 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Returning 404 to user: Instance 6f8e319e-213d-425f-9d28-c95848201859 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:56.360545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1dca64dd-e781-45c2-8786-832cd5d77104 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859" status: 404 len: 111 microversion: 2.1 time: 0.034542 Jun 22 10:20:56.360545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 203/414] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:56 2022] GET /compute/v2.1/servers/6f8e319e-213d-425f-9d28-c95848201859 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:20:56.361310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-69e60f44-9daa-4085-b7eb-ba9c9f654bba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:56.361862 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-69e60f44-9daa-4085-b7eb-ba9c9f654bba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:56.362705 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-69e60f44-9daa-4085-b7eb-ba9c9f654bba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:56.363146 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-69e60f44-9daa-4085-b7eb-ba9c9f654bba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:56.478894 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-243044182", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "networks": [{"uuid": "6fe2857b-94e4-4b84-881e-f8d24be067eb"}]}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:56.511990 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-69e60f44-9daa-4085-b7eb-ba9c9f654bba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:56.519706 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-69e60f44-9daa-4085-b7eb-ba9c9f654bba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.180122 Jun 22 10:20:56.531417 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 212/415] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:56 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:56.543284 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.network.neutron [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] validate_networks() for [('6fe2857b-94e4-4b84-881e-f8d24be067eb', None, None, None, None, None)] {{(pid=118327) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:20:57.170002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Flavor limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:20:57.170469 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Image limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:20:57.171138 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Flavor pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:20:57.172428 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Image pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:20:57.173103 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:20:57.182900 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.183376 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.184172 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.184834 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.206410 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Getting quotas for project 9e06f1a9b667414b8d663033c7053b76. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:20:57.211740 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Getting quotas for user c2e02737f0cc423d95db9c3324f7215e and project 9e06f1a9b667414b8d663033c7053b76. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:20:57.225319 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Going to run 1 instances... {{(pid=118327) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:20:57.228504 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:20:57.415747 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6b6ecb68-93b6-4b04-8de2-d0f87dc844cb tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942209 Jun 22 10:20:57.416840 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 204/416] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:20:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 10:20:57.426988 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1b2d3af2-56c5-4bc1-85a8-67b1bd1a3409 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:57.427601 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1b2d3af2-56c5-4bc1-85a8-67b1bd1a3409 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:57.430474 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:57.537796 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0ba7bec1-43ba-4707-b268-b1871d44d12c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:57.538419 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0ba7bec1-43ba-4707-b268-b1871d44d12c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:57.546658 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1b2d3af2-56c5-4bc1-85a8-67b1bd1a3409 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:57.547669 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0ba7bec1-43ba-4707-b268-b1871d44d12c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.548336 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0ba7bec1-43ba-4707-b268-b1871d44d12c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.549498 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0ba7bec1-43ba-4707-b268-b1871d44d12c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.550099 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0ba7bec1-43ba-4707-b268-b1871d44d12c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.568245 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1b2d3af2-56c5-4bc1-85a8-67b1bd1a3409 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1213 microversion: 2.1 time: 0.144528 Jun 22 10:20:57.568245 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 213/417] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:57 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:57.735782 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0ba7bec1-43ba-4707-b268-b1871d44d12c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:57.744179 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0ba7bec1-43ba-4707-b268-b1871d44d12c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.209576 Jun 22 10:20:57.744850 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 205/418] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:57 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:58.585039 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-31a98c81-93df-4cfb-9164-f4ce0c020e05 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:58.585653 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-31a98c81-93df-4cfb-9164-f4ce0c020e05 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:58.593855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-31a98c81-93df-4cfb-9164-f4ce0c020e05 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.599579 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-31a98c81-93df-4cfb-9164-f4ce0c020e05 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.599579 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-31a98c81-93df-4cfb-9164-f4ce0c020e05 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.599579 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-31a98c81-93df-4cfb-9164-f4ce0c020e05 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.689299 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-31a98c81-93df-4cfb-9164-f4ce0c020e05 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:58.698286 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-31a98c81-93df-4cfb-9164-f4ce0c020e05 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1217 microversion: 2.1 time: 0.117062 Jun 22 10:20:58.698873 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 214/419] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:58 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:58.761534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4f3a0f79-fe1f-45b9-9293-697bf430aa9c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:58.762394 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4f3a0f79-fe1f-45b9-9293-697bf430aa9c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:58.781600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f3a0f79-fe1f-45b9-9293-697bf430aa9c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.782116 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f3a0f79-fe1f-45b9-9293-697bf430aa9c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.783130 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f3a0f79-fe1f-45b9-9293-697bf430aa9c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.787621 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f3a0f79-fe1f-45b9-9293-697bf430aa9c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.954672 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4f3a0f79-fe1f-45b9-9293-697bf430aa9c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:58.966408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4f3a0f79-fe1f-45b9-9293-697bf430aa9c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.209883 Jun 22 10:20:58.966993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 206/420] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:58 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:59.717416 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-43b2cf9b-3047-49e8-a5ea-7ec442ec01d9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:59.718393 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-43b2cf9b-3047-49e8-a5ea-7ec442ec01d9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:59.725739 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-43b2cf9b-3047-49e8-a5ea-7ec442ec01d9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:59.726199 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-43b2cf9b-3047-49e8-a5ea-7ec442ec01d9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:59.727032 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-43b2cf9b-3047-49e8-a5ea-7ec442ec01d9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:59.727420 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-43b2cf9b-3047-49e8-a5ea-7ec442ec01d9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:59.793553 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-43b2cf9b-3047-49e8-a5ea-7ec442ec01d9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:59.801186 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-43b2cf9b-3047-49e8-a5ea-7ec442ec01d9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1265 microversion: 2.1 time: 0.089563 Jun 22 10:20:59.801802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 215/421] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:59 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:59.985514 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-90066679-6366-4cfe-8cc1-8508588c54bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:59.985514 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-90066679-6366-4cfe-8cc1-8508588c54bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:59.991514 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-90066679-6366-4cfe-8cc1-8508588c54bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:59.991967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-90066679-6366-4cfe-8cc1-8508588c54bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:59.992751 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-90066679-6366-4cfe-8cc1-8508588c54bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:59.993474 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-90066679-6366-4cfe-8cc1-8508588c54bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:00.147070 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-90066679-6366-4cfe-8cc1-8508588c54bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:00.154800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-90066679-6366-4cfe-8cc1-8508588c54bb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.175501 Jun 22 10:21:00.155358 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 207/422] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:59 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:00.821926 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-014f6d67-c03a-48d9-a6b9-1922188574a8 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:00.822707 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-014f6d67-c03a-48d9-a6b9-1922188574a8 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:00.829640 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-014f6d67-c03a-48d9-a6b9-1922188574a8 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:00.830327 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-014f6d67-c03a-48d9-a6b9-1922188574a8 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:00.831100 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-014f6d67-c03a-48d9-a6b9-1922188574a8 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:00.831531 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-014f6d67-c03a-48d9-a6b9-1922188574a8 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:00.905421 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-014f6d67-c03a-48d9-a6b9-1922188574a8 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:00.913065 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-014f6d67-c03a-48d9-a6b9-1922188574a8 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1265 microversion: 2.1 time: 0.095145 Jun 22 10:21:00.922931 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 216/423] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:00 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:01.175287 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-327052d4-b237-4289-a023-c38ea5c7e12e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:01.175287 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-327052d4-b237-4289-a023-c38ea5c7e12e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:01.180871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-327052d4-b237-4289-a023-c38ea5c7e12e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.182088 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-327052d4-b237-4289-a023-c38ea5c7e12e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:01.182863 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-327052d4-b237-4289-a023-c38ea5c7e12e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.183296 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-327052d4-b237-4289-a023-c38ea5c7e12e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:01.320285 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-327052d4-b237-4289-a023-c38ea5c7e12e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:01.327855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-327052d4-b237-4289-a023-c38ea5c7e12e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.159697 Jun 22 10:21:01.328425 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 208/424] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:01 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:01.930204 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c975275a-f4b9-40a6-8055-12b6a05ecbee tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:01.930766 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c975275a-f4b9-40a6-8055-12b6a05ecbee tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:01.937958 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c975275a-f4b9-40a6-8055-12b6a05ecbee tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.938405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c975275a-f4b9-40a6-8055-12b6a05ecbee tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:01.939175 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c975275a-f4b9-40a6-8055-12b6a05ecbee tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.939788 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c975275a-f4b9-40a6-8055-12b6a05ecbee tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.016094 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c975275a-f4b9-40a6-8055-12b6a05ecbee tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:02.018854 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:02.023448 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c975275a-f4b9-40a6-8055-12b6a05ecbee tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1283 microversion: 2.1 time: 0.097039 Jun 22 10:21:02.024035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 217/425] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:01 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:02.346899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5002d326-7e1b-44ee-8865-3af48c5c85aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:02.347509 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5002d326-7e1b-44ee-8865-3af48c5c85aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:02.354086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5002d326-7e1b-44ee-8865-3af48c5c85aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:02.354531 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5002d326-7e1b-44ee-8865-3af48c5c85aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.355348 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5002d326-7e1b-44ee-8865-3af48c5c85aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:02.355781 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5002d326-7e1b-44ee-8865-3af48c5c85aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.573428 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5002d326-7e1b-44ee-8865-3af48c5c85aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:02.581307 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5002d326-7e1b-44ee-8865-3af48c5c85aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.238138 Jun 22 10:21:02.581882 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 209/426] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:02 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:03.042572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-dd4fac9f-1bf4-4013-b392-f0794ae5f327 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:03.043208 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-dd4fac9f-1bf4-4013-b392-f0794ae5f327 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:03.054710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dd4fac9f-1bf4-4013-b392-f0794ae5f327 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.055183 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dd4fac9f-1bf4-4013-b392-f0794ae5f327 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.056126 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dd4fac9f-1bf4-4013-b392-f0794ae5f327 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.056609 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dd4fac9f-1bf4-4013-b392-f0794ae5f327 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.227104 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-dd4fac9f-1bf4-4013-b392-f0794ae5f327 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:03.235534 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-dd4fac9f-1bf4-4013-b392-f0794ae5f327 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1313 microversion: 2.1 time: 0.198409 Jun 22 10:21:03.236108 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 218/427] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:03 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:03.597819 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ee46b093-f0e7-4e9c-a95b-7e5be8b47d59 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:03.598434 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ee46b093-f0e7-4e9c-a95b-7e5be8b47d59 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:03.605666 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ee46b093-f0e7-4e9c-a95b-7e5be8b47d59 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.606117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ee46b093-f0e7-4e9c-a95b-7e5be8b47d59 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.606886 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ee46b093-f0e7-4e9c-a95b-7e5be8b47d59 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.607354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ee46b093-f0e7-4e9c-a95b-7e5be8b47d59 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.753946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ee46b093-f0e7-4e9c-a95b-7e5be8b47d59 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:03.760452 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ee46b093-f0e7-4e9c-a95b-7e5be8b47d59 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1502 microversion: 2.1 time: 0.165878 Jun 22 10:21:03.761067 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 210/428] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:03 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:03.777870 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c31ae173-38a8-4260-9068-cf56a0c2d5df tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9fb69a4-9381-441a-8707-6f1db9d3a12c"}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:03.781026 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c31ae173-38a8-4260-9068-cf56a0c2d5df tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:03.785795 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c31ae173-38a8-4260-9068-cf56a0c2d5df tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.786207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c31ae173-38a8-4260-9068-cf56a0c2d5df tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.786963 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c31ae173-38a8-4260-9068-cf56a0c2d5df tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.787396 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c31ae173-38a8-4260-9068-cf56a0c2d5df tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.811116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-c31ae173-38a8-4260-9068-cf56a0c2d5df tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] HTTP exception thrown: Cannot 'attach_volume' instance 398fb416-b4c6-4b43-80be-683e1a41721b while it is in vm_state rescued Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c31ae173-38a8-4260-9068-cf56a0c2d5df tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Request method failure captured: Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: POST /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b/os-volume_attachments HTTP/1.1 Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 74 Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisux0IeVehkqtNo7n7J7FM8HPVJHOjCuT4m0Ji2aSNkBVMCCn6SbSuTDB7CSpzKBIHPL8itk1MLGK3PBVVED-wqW1XGpxjrpnMahJuE-_foiUHqCo7_rUnQn9l6VFl_80qm7MInXFrtEQmwRBBty2huD9MJbF9_iRgsagV3uAZLCm1iA Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 30df978aece349c4baf14cc311f7b498 Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:21:03.812805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:21:03.815059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30df978aece349c4baf14cc311f7b498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_30df978aece349c4baf14cc311f7b498", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30df978aece349c4baf14cc311f7b498"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/30df978aece349c4baf14cc311f7b498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:21:03.815059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:21:03.815059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 30df978aece349c4baf14cc311f7b498 Jun 22 10:21:03.815059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:21:03.815059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-ServerRescueNegativeTestJSON-190891196-project Jun 22 10:21:03.815059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:21:03.815059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:21:03.815059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 425bf40bd45642a1aafeb65bdb9650af Jun 22 10:21:03.815059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-ServerRescueNegativeTestJSON-190891196-project Jun 22 10:21:03.815059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Jun 22 10:21:03.815059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {"volumeAttachment": {"volumeId": "e9fb69a4-9381-441a-8707-6f1db9d3a12c"}} Jun 22 10:21:03.815059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Cannot 'attach_volume' instance 398fb416-b4c6-4b43-80be-683e1a41721b while it is in vm_state rescued Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'server_id': '398fb416-b4c6-4b43-80be-683e1a41721b', 'body': {'volumeAttachment': {'volumeId': 'e9fb69a4-9381-441a-8707-6f1db9d3a12c'}}} Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 398fb416-b4c6-4b43-80be-683e1a41721b in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:21:03.816238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 398fb416-b4c6-4b43-80be-683e1a41721b while it is in vm_state rescued Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:21:03.817647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:21:03.819005 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:21:03.819005 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:21:03.819005 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 398fb416-b4c6-4b43-80be-683e1a41721b while it is in vm_state rescued Jun 22 10:21:03.819005 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:21:03.819005 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c31ae173-38a8-4260-9068-cf56a0c2d5df tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Returning 409 to user: Cannot 'attach_volume' instance 398fb416-b4c6-4b43-80be-683e1a41721b while it is in vm_state rescued {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:21:03.819005 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c31ae173-38a8-4260-9068-cf56a0c2d5df tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "POST /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040996 Jun 22 10:21:03.819005 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 219/429] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:21:03 2022] POST /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 10:21:03.824576 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-88f0085b-84b1-4f54-92a1-eab523e91505 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:03.825143 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-88f0085b-84b1-4f54-92a1-eab523e91505 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:03.831323 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-88f0085b-84b1-4f54-92a1-eab523e91505 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.831683 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-88f0085b-84b1-4f54-92a1-eab523e91505 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.832443 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-88f0085b-84b1-4f54-92a1-eab523e91505 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.832990 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-88f0085b-84b1-4f54-92a1-eab523e91505 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:04.146442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-88f0085b-84b1-4f54-92a1-eab523e91505 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "POST /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b/action" status: 202 len: 0 microversion: 2.1 time: 0.310319 Jun 22 10:21:04.148739 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 211/430] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:21:03 2022] POST /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:21:04.159064 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8090eacd-fa11-4ff0-98ab-39f9e37be09c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:04.159064 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8090eacd-fa11-4ff0-98ab-39f9e37be09c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:04.165599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8090eacd-fa11-4ff0-98ab-39f9e37be09c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:04.166330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8090eacd-fa11-4ff0-98ab-39f9e37be09c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:04.167729 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8090eacd-fa11-4ff0-98ab-39f9e37be09c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:04.168770 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8090eacd-fa11-4ff0-98ab-39f9e37be09c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:04.254935 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0b78b77b-8e77-492a-9282-a5016dcff1f3 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:04.255741 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0b78b77b-8e77-492a-9282-a5016dcff1f3 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:04.267648 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b78b77b-8e77-492a-9282-a5016dcff1f3 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:04.268194 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b78b77b-8e77-492a-9282-a5016dcff1f3 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:04.269249 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b78b77b-8e77-492a-9282-a5016dcff1f3 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:04.269782 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b78b77b-8e77-492a-9282-a5016dcff1f3 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:04.393415 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8090eacd-fa11-4ff0-98ab-39f9e37be09c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:04.402643 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8090eacd-fa11-4ff0-98ab-39f9e37be09c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1510 microversion: 2.1 time: 0.250594 Jun 22 10:21:04.403695 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 220/431] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:04 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:04.430867 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-fecb3b0e-29e3-4578-9c01-ebd3415466a3 req-dcc5ddbb-e141-48a5-a960-810645c074e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e71b192e-29e3-4902-bfb9-4b1bb6d948a1", "tag": "b7a01b07-4715-4acb-90f1-70645e046dc9"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:04.434672 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-fecb3b0e-29e3-4578-9c01-ebd3415466a3 req-dcc5ddbb-e141-48a5-a960-810645c074e1 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:04.435117 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-fecb3b0e-29e3-4578-9c01-ebd3415466a3 req-dcc5ddbb-e141-48a5-a960-810645c074e1 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:04.449378 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-fecb3b0e-29e3-4578-9c01-ebd3415466a3 req-dcc5ddbb-e141-48a5-a960-810645c074e1 service nova] Creating event network-changed:b7a01b07-4715-4acb-90f1-70645e046dc9 for instance e71b192e-29e3-4902-bfb9-4b1bb6d948a1 on hv-cinder-84327 Jun 22 10:21:04.459386 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-fecb3b0e-29e3-4578-9c01-ebd3415466a3 req-dcc5ddbb-e141-48a5-a960-810645c074e1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041053 Jun 22 10:21:04.460610 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 221/432] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:04.475806 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0b78b77b-8e77-492a-9282-a5016dcff1f3 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:04.489631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0b78b77b-8e77-492a-9282-a5016dcff1f3 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1313 microversion: 2.1 time: 0.239401 Jun 22 10:21:04.494084 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 212/433] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:04 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:05.423396 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8f8dc039-80a8-421d-a8a8-d44baef0797e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:05.426770 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8f8dc039-80a8-421d-a8a8-d44baef0797e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:05.431313 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8f8dc039-80a8-421d-a8a8-d44baef0797e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.431703 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8f8dc039-80a8-421d-a8a8-d44baef0797e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.432488 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8f8dc039-80a8-421d-a8a8-d44baef0797e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.432954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8f8dc039-80a8-421d-a8a8-d44baef0797e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.507816 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c5e3d99d-df46-4203-9aa5-9dfa9b945ba1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:05.508431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c5e3d99d-df46-4203-9aa5-9dfa9b945ba1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:05.515526 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5e3d99d-df46-4203-9aa5-9dfa9b945ba1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.520631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5e3d99d-df46-4203-9aa5-9dfa9b945ba1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.520631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5e3d99d-df46-4203-9aa5-9dfa9b945ba1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.520631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5e3d99d-df46-4203-9aa5-9dfa9b945ba1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.709660 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8f8dc039-80a8-421d-a8a8-d44baef0797e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:05.719640 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8f8dc039-80a8-421d-a8a8-d44baef0797e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1510 microversion: 2.1 time: 0.300435 Jun 22 10:21:05.720855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 222/434] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:05 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1510 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:05.741467 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c5e3d99d-df46-4203-9aa5-9dfa9b945ba1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:05.750197 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c5e3d99d-df46-4203-9aa5-9dfa9b945ba1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1313 microversion: 2.1 time: 0.246229 Jun 22 10:21:05.750773 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 213/435] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:05 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:06.737302 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3a26f794-bc66-4166-b362-808c3d7e0938 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:06.738167 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3a26f794-bc66-4166-b362-808c3d7e0938 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:06.747802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3a26f794-bc66-4166-b362-808c3d7e0938 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:06.748359 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3a26f794-bc66-4166-b362-808c3d7e0938 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:06.749402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3a26f794-bc66-4166-b362-808c3d7e0938 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:06.750238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3a26f794-bc66-4166-b362-808c3d7e0938 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:06.767662 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c3b14497-5a19-45f8-a3f7-f2b7f71631bc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:06.768444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c3b14497-5a19-45f8-a3f7-f2b7f71631bc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:06.780346 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c3b14497-5a19-45f8-a3f7-f2b7f71631bc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:06.781195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c3b14497-5a19-45f8-a3f7-f2b7f71631bc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:06.783774 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c3b14497-5a19-45f8-a3f7-f2b7f71631bc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:06.784414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c3b14497-5a19-45f8-a3f7-f2b7f71631bc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:06.989634 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3a26f794-bc66-4166-b362-808c3d7e0938 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:06.991186 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c3b14497-5a19-45f8-a3f7-f2b7f71631bc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:06.998789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3a26f794-bc66-4166-b362-808c3d7e0938 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1510 microversion: 2.1 time: 0.265990 Jun 22 10:21:07.002607 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c3b14497-5a19-45f8-a3f7-f2b7f71631bc tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1313 microversion: 2.1 time: 0.239037 Jun 22 10:21:07.013340 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 214/436] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:06 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:07.013491 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 223/437] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:06 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1510 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:08.019545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d55a4915-be51-4261-b113-9e66ce093d2c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:08.020156 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d55a4915-be51-4261-b113-9e66ce093d2c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:08.021050 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-847e4246-e440-4959-bb42-2146daa5f8e9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:08.021658 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-847e4246-e440-4959-bb42-2146daa5f8e9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:08.022170 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:08.031969 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=6 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:08.032144 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:08.032144 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-847e4246-e440-4959-bb42-2146daa5f8e9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.032333 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d55a4915-be51-4261-b113-9e66ce093d2c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.032451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-847e4246-e440-4959-bb42-2146daa5f8e9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.032540 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d55a4915-be51-4261-b113-9e66ce093d2c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.032637 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-847e4246-e440-4959-bb42-2146daa5f8e9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.032723 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d55a4915-be51-4261-b113-9e66ce093d2c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.032832 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-847e4246-e440-4959-bb42-2146daa5f8e9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.032921 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d55a4915-be51-4261-b113-9e66ce093d2c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.252268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d55a4915-be51-4261-b113-9e66ce093d2c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:08.252529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-847e4246-e440-4959-bb42-2146daa5f8e9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:08.257242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:08.261980 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-847e4246-e440-4959-bb42-2146daa5f8e9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1313 microversion: 2.1 time: 0.244773 Jun 22 10:21:08.262573 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 224/438] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:08 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:08.263238 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d55a4915-be51-4261-b113-9e66ce093d2c tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1510 microversion: 2.1 time: 0.247393 Jun 22 10:21:08.263977 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 215/439] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:08 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1510 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:09.279845 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2c88d520-b3bf-4b23-9518-cf6fc9cf40d7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:09.280504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2c88d520-b3bf-4b23-9518-cf6fc9cf40d7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:09.281739 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a7561906-a878-435c-b617-933707de35a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:09.282295 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a7561906-a878-435c-b617-933707de35a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:09.287012 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c88d520-b3bf-4b23-9518-cf6fc9cf40d7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:09.287454 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c88d520-b3bf-4b23-9518-cf6fc9cf40d7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:09.288217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c88d520-b3bf-4b23-9518-cf6fc9cf40d7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:09.288642 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c88d520-b3bf-4b23-9518-cf6fc9cf40d7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:09.290251 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a7561906-a878-435c-b617-933707de35a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:09.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a7561906-a878-435c-b617-933707de35a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:09.291545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a7561906-a878-435c-b617-933707de35a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:09.292431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a7561906-a878-435c-b617-933707de35a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:09.485529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2c88d520-b3bf-4b23-9518-cf6fc9cf40d7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:09.492447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a7561906-a878-435c-b617-933707de35a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:09.493408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2c88d520-b3bf-4b23-9518-cf6fc9cf40d7 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1313 microversion: 2.1 time: 0.217842 Jun 22 10:21:09.493985 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 225/440] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:09 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:09.500007 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a7561906-a878-435c-b617-933707de35a2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1510 microversion: 2.1 time: 0.223351 Jun 22 10:21:09.500568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 216/441] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:09 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:10.509697 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3363c143-2122-4721-a1b2-0f9108552079 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:10.510320 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3363c143-2122-4721-a1b2-0f9108552079 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:10.517053 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4cc90911-b458-4c65-bf8a-4759c868de93 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:10.517728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4cc90911-b458-4c65-bf8a-4759c868de93 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:10.518035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3363c143-2122-4721-a1b2-0f9108552079 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:10.518495 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3363c143-2122-4721-a1b2-0f9108552079 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:10.519314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3363c143-2122-4721-a1b2-0f9108552079 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:10.519753 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3363c143-2122-4721-a1b2-0f9108552079 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:10.528026 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4cc90911-b458-4c65-bf8a-4759c868de93 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:10.528712 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4cc90911-b458-4c65-bf8a-4759c868de93 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:10.531390 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4cc90911-b458-4c65-bf8a-4759c868de93 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:10.531390 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4cc90911-b458-4c65-bf8a-4759c868de93 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:10.724863 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3363c143-2122-4721-a1b2-0f9108552079 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:10.732714 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4cc90911-b458-4c65-bf8a-4759c868de93 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:10.735198 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3363c143-2122-4721-a1b2-0f9108552079 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1313 microversion: 2.1 time: 0.226777 Jun 22 10:21:10.737359 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 226/442] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:10 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:10.748233 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4cc90911-b458-4c65-bf8a-4759c868de93 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1510 microversion: 2.1 time: 0.235092 Jun 22 10:21:10.748805 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 217/443] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:10 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1510 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:11.752523 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-94469e34-8c00-429a-b73a-da529ee382f0 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:11.753262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-94469e34-8c00-429a-b73a-da529ee382f0 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:11.759741 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-94469e34-8c00-429a-b73a-da529ee382f0 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:11.760311 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-94469e34-8c00-429a-b73a-da529ee382f0 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:11.761231 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-94469e34-8c00-429a-b73a-da529ee382f0 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:11.761737 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-94469e34-8c00-429a-b73a-da529ee382f0 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:11.764503 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0269e4ad-170a-4856-8e20-34342804fca9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:11.765161 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0269e4ad-170a-4856-8e20-34342804fca9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:11.772623 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0269e4ad-170a-4856-8e20-34342804fca9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:11.773370 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0269e4ad-170a-4856-8e20-34342804fca9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:11.774150 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0269e4ad-170a-4856-8e20-34342804fca9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:11.774593 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0269e4ad-170a-4856-8e20-34342804fca9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:11.964492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-94469e34-8c00-429a-b73a-da529ee382f0 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:11.967504 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0269e4ad-170a-4856-8e20-34342804fca9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:11.972256 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-94469e34-8c00-429a-b73a-da529ee382f0 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1313 microversion: 2.1 time: 0.223460 Jun 22 10:21:11.972935 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 227/444] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:11 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:11.974908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0269e4ad-170a-4856-8e20-34342804fca9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1510 microversion: 2.1 time: 0.214216 Jun 22 10:21:11.975456 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 218/445] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:11 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:12.991461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-08d52306-d06f-4360-a9cb-db19b3b12bf3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:12.992311 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-08d52306-d06f-4360-a9cb-db19b3b12bf3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:12.992448 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8ecd6b8e-cc99-4a84-a872-c81607fca396 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:12.993126 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8ecd6b8e-cc99-4a84-a872-c81607fca396 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:12.999632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8ecd6b8e-cc99-4a84-a872-c81607fca396 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.000086 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8ecd6b8e-cc99-4a84-a872-c81607fca396 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.000195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-08d52306-d06f-4360-a9cb-db19b3b12bf3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.000725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-08d52306-d06f-4360-a9cb-db19b3b12bf3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.000934 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8ecd6b8e-cc99-4a84-a872-c81607fca396 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.001376 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8ecd6b8e-cc99-4a84-a872-c81607fca396 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.001712 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-08d52306-d06f-4360-a9cb-db19b3b12bf3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.002290 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-08d52306-d06f-4360-a9cb-db19b3b12bf3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.254650 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-08d52306-d06f-4360-a9cb-db19b3b12bf3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:13.264300 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-08d52306-d06f-4360-a9cb-db19b3b12bf3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1510 microversion: 2.1 time: 0.276473 Jun 22 10:21:13.264917 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 219/446] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:12 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:13.281855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8ecd6b8e-cc99-4a84-a872-c81607fca396 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:13.291326 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8ecd6b8e-cc99-4a84-a872-c81607fca396 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1313 microversion: 2.1 time: 0.303551 Jun 22 10:21:13.292995 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 228/447] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:12 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:14.281591 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c9c3306f-a56b-4054-8d1e-077d48fe1bfb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:14.282214 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c9c3306f-a56b-4054-8d1e-077d48fe1bfb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:14.288653 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c9c3306f-a56b-4054-8d1e-077d48fe1bfb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:14.289150 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c9c3306f-a56b-4054-8d1e-077d48fe1bfb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:14.290538 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c9c3306f-a56b-4054-8d1e-077d48fe1bfb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:14.290538 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c9c3306f-a56b-4054-8d1e-077d48fe1bfb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:14.307940 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-54f36fba-33b4-4db8-8b0e-8997a13f78a9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:14.309503 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-54f36fba-33b4-4db8-8b0e-8997a13f78a9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:14.316603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-54f36fba-33b4-4db8-8b0e-8997a13f78a9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:14.317087 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-54f36fba-33b4-4db8-8b0e-8997a13f78a9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:14.317864 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-54f36fba-33b4-4db8-8b0e-8997a13f78a9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:14.318645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-54f36fba-33b4-4db8-8b0e-8997a13f78a9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:14.520321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c9c3306f-a56b-4054-8d1e-077d48fe1bfb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:14.521571 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-54f36fba-33b4-4db8-8b0e-8997a13f78a9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:14.530846 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-54f36fba-33b4-4db8-8b0e-8997a13f78a9 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1313 microversion: 2.1 time: 0.227089 Jun 22 10:21:14.531524 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 229/448] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:14 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:14.538730 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c9c3306f-a56b-4054-8d1e-077d48fe1bfb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1510 microversion: 2.1 time: 0.260725 Jun 22 10:21:14.546602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 220/449] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:14 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:15.132149 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-046699d5-afbf-4c2a-8220-f1385b11fbc5 req-e09d891d-71c2-463e-b635-1594fcf7a807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71b192e-29e3-4902-bfb9-4b1bb6d948a1", "name": "network-vif-plugged", "status": "completed", "tag": "b7a01b07-4715-4acb-90f1-70645e046dc9"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:15.141326 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-046699d5-afbf-4c2a-8220-f1385b11fbc5 req-e09d891d-71c2-463e-b635-1594fcf7a807 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.141935 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-046699d5-afbf-4c2a-8220-f1385b11fbc5 req-e09d891d-71c2-463e-b635-1594fcf7a807 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.154501 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-046699d5-afbf-4c2a-8220-f1385b11fbc5 req-e09d891d-71c2-463e-b635-1594fcf7a807 service nova] Creating event network-vif-plugged:b7a01b07-4715-4acb-90f1-70645e046dc9 for instance e71b192e-29e3-4902-bfb9-4b1bb6d948a1 on hv-cinder-84327 Jun 22 10:21:15.159715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-046699d5-afbf-4c2a-8220-f1385b11fbc5 req-e09d891d-71c2-463e-b635-1594fcf7a807 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032131 Jun 22 10:21:15.160513 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 230/450] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:15.549168 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-856cb289-e129-44d4-8ad6-3624d2c12789 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:15.567598 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-856cb289-e129-44d4-8ad6-3624d2c12789 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:15.567743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bb6f1d73-7811-49b6-a8fb-7b802c40ecc5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:15.567743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bb6f1d73-7811-49b6-a8fb-7b802c40ecc5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:15.570612 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-856cb289-e129-44d4-8ad6-3624d2c12789 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.571565 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-856cb289-e129-44d4-8ad6-3624d2c12789 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.571678 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb6f1d73-7811-49b6-a8fb-7b802c40ecc5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.572100 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb6f1d73-7811-49b6-a8fb-7b802c40ecc5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.572808 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-856cb289-e129-44d4-8ad6-3624d2c12789 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.572945 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb6f1d73-7811-49b6-a8fb-7b802c40ecc5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.573028 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-856cb289-e129-44d4-8ad6-3624d2c12789 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.573329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb6f1d73-7811-49b6-a8fb-7b802c40ecc5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.812793 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bb6f1d73-7811-49b6-a8fb-7b802c40ecc5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:15.820780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bb6f1d73-7811-49b6-a8fb-7b802c40ecc5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1516 microversion: 2.1 time: 0.267800 Jun 22 10:21:15.821403 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 231/451] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:15 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1516 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:15.830542 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-856cb289-e129-44d4-8ad6-3624d2c12789 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:15.838688 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-856cb289-e129-44d4-8ad6-3624d2c12789 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1313 microversion: 2.1 time: 0.294133 Jun 22 10:21:15.839468 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 221/452] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:15 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:16.856018 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0c3a3c9e-f50c-41ee-9add-8fbb0b6281f2 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:16.856660 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0c3a3c9e-f50c-41ee-9add-8fbb0b6281f2 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:16.862784 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0c3a3c9e-f50c-41ee-9add-8fbb0b6281f2 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:16.863235 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0c3a3c9e-f50c-41ee-9add-8fbb0b6281f2 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:16.864833 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0c3a3c9e-f50c-41ee-9add-8fbb0b6281f2 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:16.864833 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0c3a3c9e-f50c-41ee-9add-8fbb0b6281f2 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:16.999753 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0c3a3c9e-f50c-41ee-9add-8fbb0b6281f2 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:17.007445 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0c3a3c9e-f50c-41ee-9add-8fbb0b6281f2 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1313 microversion: 2.1 time: 0.155435 Jun 22 10:21:17.008076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 232/453] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:16 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:18.025260 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cbe40228-8eff-4071-a494-f4f8cf482ee1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:18.025746 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-cbe40228-8eff-4071-a494-f4f8cf482ee1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:18.032131 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cbe40228-8eff-4071-a494-f4f8cf482ee1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:18.032560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cbe40228-8eff-4071-a494-f4f8cf482ee1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:18.033355 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cbe40228-8eff-4071-a494-f4f8cf482ee1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:18.033793 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cbe40228-8eff-4071-a494-f4f8cf482ee1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:18.163751 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cbe40228-8eff-4071-a494-f4f8cf482ee1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:18.172052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cbe40228-8eff-4071-a494-f4f8cf482ee1 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1496 microversion: 2.1 time: 0.151027 Jun 22 10:21:18.172680 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 222/454] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:18 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1496 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:18.802027 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-06d929af-e55e-45aa-8aed-c98195fb1260 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Action: 'create', calling method: .version_select at 0x7f021fe3be50>, body: {"keypair": {"name": "tempest-keypair-1079997507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWr9I1rzgTjR+jK42y5UopjdF0SFMxIEBmXUUONjX3qOWC+goHMsG5Ow/k1+u7rECCjI5B78mEPUCfi8GLo2phg8CB4gRvNYUg3S9nrY9FI9w9+985wB3iARIXtP7sOGQ=="}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:18.816104 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-06d929af-e55e-45aa-8aed-c98195fb1260 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Getting quotas for project 30df978aece349c4baf14cc311f7b498. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:21:18.820120 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-06d929af-e55e-45aa-8aed-c98195fb1260 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Getting quotas for user 425bf40bd45642a1aafeb65bdb9650af and project 30df978aece349c4baf14cc311f7b498. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:21:18.957666 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-06d929af-e55e-45aa-8aed-c98195fb1260 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159256 Jun 22 10:21:18.958147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 233/455] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jun 22 10:21:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:19.087338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6954690d-86c8-4e85-ad5b-ff08867fa971 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:19.087969 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6954690d-86c8-4e85-ad5b-ff08867fa971 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:19.095431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6954690d-86c8-4e85-ad5b-ff08867fa971 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.095883 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6954690d-86c8-4e85-ad5b-ff08867fa971 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.096663 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6954690d-86c8-4e85-ad5b-ff08867fa971 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.097131 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6954690d-86c8-4e85-ad5b-ff08867fa971 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.123961 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6954690d-86c8-4e85-ad5b-ff08867fa971 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Going to try to terminate instance {{(pid=118327) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:21:19.490116 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6954690d-86c8-4e85-ad5b-ff08867fa971 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 204 len: 0 microversion: 2.1 time: 0.406333 Jun 22 10:21:19.490747 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 223/456] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:21:19 2022] DELETE /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:21:19.499801 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-80c2eba4-567e-4a17-9bdd-5bfbf5984bb6 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:19.500426 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-80c2eba4-567e-4a17-9bdd-5bfbf5984bb6 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:19.506597 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80c2eba4-567e-4a17-9bdd-5bfbf5984bb6 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.507078 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80c2eba4-567e-4a17-9bdd-5bfbf5984bb6 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.507826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80c2eba4-567e-4a17-9bdd-5bfbf5984bb6 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.508268 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80c2eba4-567e-4a17-9bdd-5bfbf5984bb6 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.650689 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-80c2eba4-567e-4a17-9bdd-5bfbf5984bb6 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:19.658152 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-80c2eba4-567e-4a17-9bdd-5bfbf5984bb6 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1502 microversion: 2.1 time: 0.162910 Jun 22 10:21:19.658714 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 234/457] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:19 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:20.680904 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-13acc766-e157-48f6-afee-cdbf0386b230 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:20.682443 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-13acc766-e157-48f6-afee-cdbf0386b230 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:20.697691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-13acc766-e157-48f6-afee-cdbf0386b230 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:20.698214 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-13acc766-e157-48f6-afee-cdbf0386b230 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:20.699134 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-13acc766-e157-48f6-afee-cdbf0386b230 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:20.700652 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-13acc766-e157-48f6-afee-cdbf0386b230 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:20.864312 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-13acc766-e157-48f6-afee-cdbf0386b230 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:20.872650 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-13acc766-e157-48f6-afee-cdbf0386b230 tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1502 microversion: 2.1 time: 0.197699 Jun 22 10:21:20.873698 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 224/458] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:20 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:21.731696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2096387380", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d87deb7b-7760-4ec4-9151-26b90b71d248"}], "security_groups": [{"name": "tempest-securitygroup--454779114"}], "key_name": "tempest-keypair-1079997507", "user_data": "}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:21.802101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-d484dded-8c4b-4316-a220-96c52bef3136 req-c4224cf2-c1f9-45e2-b8cf-49f1bc3559c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e71b192e-29e3-4902-bfb9-4b1bb6d948a1", "name": "network-vif-deleted", "tag": "b7a01b07-4715-4acb-90f1-70645e046dc9"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:21.811575 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-d484dded-8c4b-4316-a220-96c52bef3136 req-c4224cf2-c1f9-45e2-b8cf-49f1bc3559c0 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:21.812021 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-d484dded-8c4b-4316-a220-96c52bef3136 req-c4224cf2-c1f9-45e2-b8cf-49f1bc3559c0 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:21.823479 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-d484dded-8c4b-4316-a220-96c52bef3136 req-c4224cf2-c1f9-45e2-b8cf-49f1bc3559c0 service nova] Creating event network-vif-deleted:b7a01b07-4715-4acb-90f1-70645e046dc9 for instance e71b192e-29e3-4902-bfb9-4b1bb6d948a1 on hv-cinder-84327 Jun 22 10:21:21.829438 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-d484dded-8c4b-4316-a220-96c52bef3136 req-c4224cf2-c1f9-45e2-b8cf-49f1bc3559c0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031083 Jun 22 10:21:21.830321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 225/459] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:21:21.850808 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.network.neutron [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] validate_networks() for [('d87deb7b-7760-4ec4-9151-26b90b71d248', None, None, None, None, None)] {{(pid=118326) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:21:21.891617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9b2b783a-9694-41fd-be5d-f32463845e1b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:21.892285 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9b2b783a-9694-41fd-be5d-f32463845e1b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:21.899760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9b2b783a-9694-41fd-be5d-f32463845e1b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:21.900205 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9b2b783a-9694-41fd-be5d-f32463845e1b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:21.901021 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9b2b783a-9694-41fd-be5d-f32463845e1b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:21.901449 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9b2b783a-9694-41fd-be5d-f32463845e1b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:21.979537 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9b2b783a-9694-41fd-be5d-f32463845e1b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:21.989948 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9b2b783a-9694-41fd-be5d-f32463845e1b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1460 microversion: 2.1 time: 0.103166 Jun 22 10:21:21.990515 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 226/460] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:21 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1460 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:22.314744 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Flavor limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:21:22.315454 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Image limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:21:22.315803 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Flavor pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:21:22.316287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Image pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:21:22.316775 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:21:22.326633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.327088 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.327893 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.328332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.349688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Getting quotas for project 30df978aece349c4baf14cc311f7b498. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:21:22.356553 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Getting quotas for user 425bf40bd45642a1aafeb65bdb9650af and project 30df978aece349c4baf14cc311f7b498. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:21:22.373439 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Going to run 1 instances... {{(pid=118326) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:21:22.381596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118326) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:21:22.539553 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ec70e249-7dc3-4e36-b01e-9eb91b14ab1b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.812490 Jun 22 10:21:22.547412 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 235/461] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:21:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:21:22.553516 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1c888ae9-1971-4d86-bb74-f96b19220d89 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:22.554463 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1c888ae9-1971-4d86-bb74-f96b19220d89 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:22.639354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1c888ae9-1971-4d86-bb74-f96b19220d89 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:22.646641 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1c888ae9-1971-4d86-bb74-f96b19220d89 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1246 microversion: 2.1 time: 0.098097 Jun 22 10:21:22.647215 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 227/462] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:22 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:23.007564 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-366f0b43-c2b3-48dc-b3bd-6abd9bbaca5b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:23.008437 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-366f0b43-c2b3-48dc-b3bd-6abd9bbaca5b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:23.016132 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-366f0b43-c2b3-48dc-b3bd-6abd9bbaca5b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.016652 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-366f0b43-c2b3-48dc-b3bd-6abd9bbaca5b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.017542 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-366f0b43-c2b3-48dc-b3bd-6abd9bbaca5b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.018053 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-366f0b43-c2b3-48dc-b3bd-6abd9bbaca5b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.055358 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-366f0b43-c2b3-48dc-b3bd-6abd9bbaca5b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.056071 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-366f0b43-c2b3-48dc-b3bd-6abd9bbaca5b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.056580 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-366f0b43-c2b3-48dc-b3bd-6abd9bbaca5b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lazy-loading 'fault' on Instance uuid e71b192e-29e3-4902-bfb9-4b1bb6d948a1 {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:21:23.104974 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-366f0b43-c2b3-48dc-b3bd-6abd9bbaca5b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e02737f0cc423d95db9c3324f7215e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e06f1a9b667414b8d663033c7053b76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:23.112587 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-366f0b43-c2b3-48dc-b3bd-6abd9bbaca5b tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 200 len: 1303 microversion: 2.1 time: 0.109034 Jun 22 10:21:23.113268 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 236/463] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:23 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:23.665228 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4f89a901-e66d-4a45-9882-f2e6ad51a9aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:23.666748 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4f89a901-e66d-4a45-9882-f2e6ad51a9aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:23.677201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f89a901-e66d-4a45-9882-f2e6ad51a9aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.677747 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f89a901-e66d-4a45-9882-f2e6ad51a9aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.679529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f89a901-e66d-4a45-9882-f2e6ad51a9aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.679529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f89a901-e66d-4a45-9882-f2e6ad51a9aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.747176 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4f89a901-e66d-4a45-9882-f2e6ad51a9aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:23.758451 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4f89a901-e66d-4a45-9882-f2e6ad51a9aa tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1250 microversion: 2.1 time: 0.098558 Jun 22 10:21:23.759295 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 228/464] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:23 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1250 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:24.130342 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-dfc7fcc2-e3d0-475f-8d79-1dcb6f7f409d tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:24.130959 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-dfc7fcc2-e3d0-475f-8d79-1dcb6f7f409d tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] [instance: e71b192e-29e3-4902-bfb9-4b1bb6d948a1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:24.138546 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dfc7fcc2-e3d0-475f-8d79-1dcb6f7f409d tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:24.139426 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dfc7fcc2-e3d0-475f-8d79-1dcb6f7f409d tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:24.140295 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dfc7fcc2-e3d0-475f-8d79-1dcb6f7f409d tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:24.140980 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dfc7fcc2-e3d0-475f-8d79-1dcb6f7f409d tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:24.158331 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-dfc7fcc2-e3d0-475f-8d79-1dcb6f7f409d tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] HTTP exception thrown: Instance e71b192e-29e3-4902-bfb9-4b1bb6d948a1 could not be found. Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-dfc7fcc2-e3d0-475f-8d79-1dcb6f7f409d tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Request method failure captured: Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 HTTP/1.1 Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisuzghJ3GchlQM-y_1ZKxaTCL2sH9-CPIMZC72dEKm0Q40wvSsX7mqhZcS1TKCSt7pY1xcWmJrjILQUwB3D6J_DHIc_PB9jxfQkTNZv0H-Aqa4Fu3hvT7gTCBE1Xi89jcNTSeUlum-Ny35JYrZxTiCXyNR-pagr_EcjUgxPVqRB0UFwY Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 9e06f1a9b667414b8d663033c7053b76 Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-VolumesActionsTest-1236945761 Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:21:24.160690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:21:24.162329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9e06f1a9b667414b8d663033c7053b76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9e06f1a9b667414b8d663033c7053b76", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9e06f1a9b667414b8d663033c7053b76"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9e06f1a9b667414b8d663033c7053b76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:21:24.162329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-VolumesActionsTest-1236945761 Jun 22 10:21:24.162329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 9e06f1a9b667414b8d663033c7053b76 Jun 22 10:21:24.162329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-VolumesActionsTest-1236945761 Jun 22 10:21:24.162329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-VolumesActionsTest-1236945761-project Jun 22 10:21:24.162329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:21:24.162329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:21:24.162329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: c2e02737f0cc423d95db9c3324f7215e Jun 22 10:21:24.162329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-VolumesActionsTest-1236945761-project Jun 22 10:21:24.162329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:21:24.162329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance e71b192e-29e3-4902-bfb9-4b1bb6d948a1 could not be found. Jun 22 10:21:24.162329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': 'e71b192e-29e3-4902-bfb9-4b1bb6d948a1'} Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e71b192e-29e3-4902-bfb9-4b1bb6d948a1 could not be found. Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:21:24.163193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e71b192e-29e3-4902-bfb9-4b1bb6d948a1 could not be found. Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e71b192e-29e3-4902-bfb9-4b1bb6d948a1 could not be found. Jun 22 10:21:24.166418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:21:24.167652 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-dfc7fcc2-e3d0-475f-8d79-1dcb6f7f409d tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] Returning 404 to user: Instance e71b192e-29e3-4902-bfb9-4b1bb6d948a1 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:21:24.167652 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-dfc7fcc2-e3d0-475f-8d79-1dcb6f7f409d tempest-VolumesActionsTest-1236945761 tempest-VolumesActionsTest-1236945761-project] 10.222.0.46 "GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1" status: 404 len: 111 microversion: 2.1 time: 0.036018 Jun 22 10:21:24.167652 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 237/465] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:24 2022] GET /compute/v2.1/servers/e71b192e-29e3-4902-bfb9-4b1bb6d948a1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:21:24.776377 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-723a93a5-aad0-4f8d-8cca-f2d18def8693 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:24.777742 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-723a93a5-aad0-4f8d-8cca-f2d18def8693 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:24.785825 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-723a93a5-aad0-4f8d-8cca-f2d18def8693 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:24.786218 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-723a93a5-aad0-4f8d-8cca-f2d18def8693 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:24.787016 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-723a93a5-aad0-4f8d-8cca-f2d18def8693 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:24.787453 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-723a93a5-aad0-4f8d-8cca-f2d18def8693 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:24.856415 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-723a93a5-aad0-4f8d-8cca-f2d18def8693 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:24.863861 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-723a93a5-aad0-4f8d-8cca-f2d18def8693 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1298 microversion: 2.1 time: 0.091652 Jun 22 10:21:24.864430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 229/466] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:24 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:25.881027 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-80659828-fde5-4da2-ba19-683d601791be tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:25.881612 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-80659828-fde5-4da2-ba19-683d601791be tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:25.887921 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80659828-fde5-4da2-ba19-683d601791be tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:25.888372 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80659828-fde5-4da2-ba19-683d601791be tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:25.889168 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80659828-fde5-4da2-ba19-683d601791be tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:25.889607 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80659828-fde5-4da2-ba19-683d601791be tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:25.893844 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:25.951603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-80659828-fde5-4da2-ba19-683d601791be tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:25.959167 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-80659828-fde5-4da2-ba19-683d601791be tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1304 microversion: 2.1 time: 0.082207 Jun 22 10:21:25.959736 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 238/467] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:25 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1304 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:26.977076 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5434e49b-f484-4b3f-9dfc-5763667e3e45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:26.977718 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5434e49b-f484-4b3f-9dfc-5763667e3e45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:26.980184 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:26.984943 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5434e49b-f484-4b3f-9dfc-5763667e3e45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:26.985445 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5434e49b-f484-4b3f-9dfc-5763667e3e45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:26.986135 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5434e49b-f484-4b3f-9dfc-5763667e3e45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:26.986536 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5434e49b-f484-4b3f-9dfc-5763667e3e45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.043705 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-60b05148-c5e2-40ad-92b6-4be51a21e119 req-7d2a72a0-467c-4093-98aa-1ae1347fc6dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6", "tag": "c91bf175-3a15-4ba3-8e3a-92fa06cf2063"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:27.054089 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-60b05148-c5e2-40ad-92b6-4be51a21e119 req-7d2a72a0-467c-4093-98aa-1ae1347fc6dd service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:27.054794 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-60b05148-c5e2-40ad-92b6-4be51a21e119 req-7d2a72a0-467c-4093-98aa-1ae1347fc6dd service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.074335 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-60b05148-c5e2-40ad-92b6-4be51a21e119 req-7d2a72a0-467c-4093-98aa-1ae1347fc6dd service nova] Creating event network-changed:c91bf175-3a15-4ba3-8e3a-92fa06cf2063 for instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 on hv-cinder-84327 Jun 22 10:21:27.080744 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-60b05148-c5e2-40ad-92b6-4be51a21e119 req-7d2a72a0-467c-4093-98aa-1ae1347fc6dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041363 Jun 22 10:21:27.081385 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 239/468] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:21:27.127747 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5434e49b-f484-4b3f-9dfc-5763667e3e45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:27.135551 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5434e49b-f484-4b3f-9dfc-5763667e3e45 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.162353 Jun 22 10:21:27.140596 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 230/469] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:26 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:28.154346 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-cab28180-9560-4d4d-a066-79489344fffd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:28.155042 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-cab28180-9560-4d4d-a066-79489344fffd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:28.161307 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cab28180-9560-4d4d-a066-79489344fffd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:28.161760 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cab28180-9560-4d4d-a066-79489344fffd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:28.162525 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cab28180-9560-4d4d-a066-79489344fffd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:28.163002 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cab28180-9560-4d4d-a066-79489344fffd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:28.294344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-cab28180-9560-4d4d-a066-79489344fffd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:28.301821 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-cab28180-9560-4d4d-a066-79489344fffd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.152601 Jun 22 10:21:28.302386 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 240/470] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:28 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:29.319090 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ef0efbac-fe84-4bae-9f8a-022a2552aa46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:29.319694 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ef0efbac-fe84-4bae-9f8a-022a2552aa46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:29.327017 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef0efbac-fe84-4bae-9f8a-022a2552aa46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:29.327462 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef0efbac-fe84-4bae-9f8a-022a2552aa46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:29.328217 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef0efbac-fe84-4bae-9f8a-022a2552aa46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:29.328658 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef0efbac-fe84-4bae-9f8a-022a2552aa46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:29.461314 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ef0efbac-fe84-4bae-9f8a-022a2552aa46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:29.469897 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ef0efbac-fe84-4bae-9f8a-022a2552aa46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.155297 Jun 22 10:21:29.470471 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 231/471] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:29 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:30.486864 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-dfe6a6e2-7961-44a3-ba44-4e247d584a9e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:30.487472 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-dfe6a6e2-7961-44a3-ba44-4e247d584a9e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:30.489746 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:30.494431 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dfe6a6e2-7961-44a3-ba44-4e247d584a9e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.494880 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dfe6a6e2-7961-44a3-ba44-4e247d584a9e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.495747 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dfe6a6e2-7961-44a3-ba44-4e247d584a9e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.496130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dfe6a6e2-7961-44a3-ba44-4e247d584a9e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.627032 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-dfe6a6e2-7961-44a3-ba44-4e247d584a9e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:30.635642 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-dfe6a6e2-7961-44a3-ba44-4e247d584a9e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.152541 Jun 22 10:21:30.636233 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 241/472] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:30 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:31.652131 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ff101d69-f6fc-421e-94f2-571ca7911b46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:31.652775 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ff101d69-f6fc-421e-94f2-571ca7911b46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:31.659382 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ff101d69-f6fc-421e-94f2-571ca7911b46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.659831 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ff101d69-f6fc-421e-94f2-571ca7911b46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.660608 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ff101d69-f6fc-421e-94f2-571ca7911b46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.661072 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ff101d69-f6fc-421e-94f2-571ca7911b46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.683819 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:31.802182 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ff101d69-f6fc-421e-94f2-571ca7911b46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:31.809666 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ff101d69-f6fc-421e-94f2-571ca7911b46 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.161582 Jun 22 10:21:31.810729 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 232/473] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:31 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:32.827076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9c70ad82-2e62-4e5f-ad50-9cb97f149b98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:32.827707 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9c70ad82-2e62-4e5f-ad50-9cb97f149b98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:32.829882 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:32.830736 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=10 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:32.836073 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9c70ad82-2e62-4e5f-ad50-9cb97f149b98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:32.836515 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9c70ad82-2e62-4e5f-ad50-9cb97f149b98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:32.837316 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9c70ad82-2e62-4e5f-ad50-9cb97f149b98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:32.837747 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9c70ad82-2e62-4e5f-ad50-9cb97f149b98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:32.983438 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9c70ad82-2e62-4e5f-ad50-9cb97f149b98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:32.992548 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9c70ad82-2e62-4e5f-ad50-9cb97f149b98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.169696 Jun 22 10:21:33.005140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 242/474] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:32 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:34.023304 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-48fc86e4-b770-4037-a217-8c5b18c1f51b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:34.024775 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-48fc86e4-b770-4037-a217-8c5b18c1f51b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:34.032288 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:34.034460 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-48fc86e4-b770-4037-a217-8c5b18c1f51b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:34.035185 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-48fc86e4-b770-4037-a217-8c5b18c1f51b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.036200 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-48fc86e4-b770-4037-a217-8c5b18c1f51b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:34.036893 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-48fc86e4-b770-4037-a217-8c5b18c1f51b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.206986 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-48fc86e4-b770-4037-a217-8c5b18c1f51b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:34.216405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-48fc86e4-b770-4037-a217-8c5b18c1f51b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.196805 Jun 22 10:21:34.228457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 233/475] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:34 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:35.243310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7c0dfd2d-07f7-4b11-a49c-93174e036207 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:35.245589 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7c0dfd2d-07f7-4b11-a49c-93174e036207 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:35.265989 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7c0dfd2d-07f7-4b11-a49c-93174e036207 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:35.266973 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7c0dfd2d-07f7-4b11-a49c-93174e036207 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:35.267857 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7c0dfd2d-07f7-4b11-a49c-93174e036207 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:35.268399 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7c0dfd2d-07f7-4b11-a49c-93174e036207 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:35.471319 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7c0dfd2d-07f7-4b11-a49c-93174e036207 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:35.484982 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7c0dfd2d-07f7-4b11-a49c-93174e036207 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.253763 Jun 22 10:21:35.486004 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 243/476] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:35 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:36.504294 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3054859d-b13d-4415-880b-41461e92f682 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:36.516720 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3054859d-b13d-4415-880b-41461e92f682 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:36.530270 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3054859d-b13d-4415-880b-41461e92f682 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:36.530742 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3054859d-b13d-4415-880b-41461e92f682 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:36.531590 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3054859d-b13d-4415-880b-41461e92f682 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:36.532028 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3054859d-b13d-4415-880b-41461e92f682 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:36.746651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3054859d-b13d-4415-880b-41461e92f682 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:36.757489 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3054859d-b13d-4415-880b-41461e92f682 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.257244 Jun 22 10:21:36.758281 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 234/477] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:36 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:37.773567 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bcb9068c-8e0c-45c4-b382-b455ea2c475f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:37.774199 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bcb9068c-8e0c-45c4-b382-b455ea2c475f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:37.781215 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bcb9068c-8e0c-45c4-b382-b455ea2c475f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.781712 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bcb9068c-8e0c-45c4-b382-b455ea2c475f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:37.782449 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bcb9068c-8e0c-45c4-b382-b455ea2c475f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.782886 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bcb9068c-8e0c-45c4-b382-b455ea2c475f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:38.091997 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bcb9068c-8e0c-45c4-b382-b455ea2c475f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:38.103752 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bcb9068c-8e0c-45c4-b382-b455ea2c475f tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.331407 Jun 22 10:21:38.107029 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 244/478] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:37 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:39.122897 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d4c05856-8d64-4e11-85c0-832905814785 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:39.124099 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d4c05856-8d64-4e11-85c0-832905814785 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:39.130834 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d4c05856-8d64-4e11-85c0-832905814785 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:39.131392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d4c05856-8d64-4e11-85c0-832905814785 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:39.132311 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d4c05856-8d64-4e11-85c0-832905814785 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:39.132865 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d4c05856-8d64-4e11-85c0-832905814785 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:39.336307 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d4c05856-8d64-4e11-85c0-832905814785 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:39.344241 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d4c05856-8d64-4e11-85c0-832905814785 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.225132 Jun 22 10:21:39.344848 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 235/479] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:39 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:39.551618 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-debcacf2-a56e-4471-90b0-ba47170dfbbf req-9b666197-426c-4767-8312-a8ba491cffd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6", "name": "network-vif-plugged", "status": "completed", "tag": "c91bf175-3a15-4ba3-8e3a-92fa06cf2063"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:39.563780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-debcacf2-a56e-4471-90b0-ba47170dfbbf req-9b666197-426c-4767-8312-a8ba491cffd2 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:39.564420 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-debcacf2-a56e-4471-90b0-ba47170dfbbf req-9b666197-426c-4767-8312-a8ba491cffd2 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:39.583214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-debcacf2-a56e-4471-90b0-ba47170dfbbf req-9b666197-426c-4767-8312-a8ba491cffd2 service nova] Creating event network-vif-plugged:c91bf175-3a15-4ba3-8e3a-92fa06cf2063 for instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 on hv-cinder-84327 Jun 22 10:21:39.593271 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-debcacf2-a56e-4471-90b0-ba47170dfbbf req-9b666197-426c-4767-8312-a8ba491cffd2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045014 Jun 22 10:21:39.593713 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 245/480] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:40.370820 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bd1e76fc-42a7-4799-9cea-1613569243cc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:40.372142 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bd1e76fc-42a7-4799-9cea-1613569243cc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:40.387692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bd1e76fc-42a7-4799-9cea-1613569243cc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:40.388153 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bd1e76fc-42a7-4799-9cea-1613569243cc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:40.390671 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bd1e76fc-42a7-4799-9cea-1613569243cc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:40.391500 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bd1e76fc-42a7-4799-9cea-1613569243cc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:40.580539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bd1e76fc-42a7-4799-9cea-1613569243cc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:40.590702 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bd1e76fc-42a7-4799-9cea-1613569243cc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.230407 Jun 22 10:21:40.601739 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 236/481] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:40 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:41.610973 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0a006352-17dd-4fac-9d41-c6cc287eccec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:41.611723 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0a006352-17dd-4fac-9d41-c6cc287eccec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:41.619158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0a006352-17dd-4fac-9d41-c6cc287eccec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:41.620149 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0a006352-17dd-4fac-9d41-c6cc287eccec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:41.621189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0a006352-17dd-4fac-9d41-c6cc287eccec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:41.621623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0a006352-17dd-4fac-9d41-c6cc287eccec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:41.834042 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0a006352-17dd-4fac-9d41-c6cc287eccec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:41.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0a006352-17dd-4fac-9d41-c6cc287eccec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1371 microversion: 2.1 time: 0.239510 Jun 22 10:21:41.844702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 246/482] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:41 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:42.861268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a592586e-a25b-4eeb-80e8-67e2a40816e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:42.862058 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a592586e-a25b-4eeb-80e8-67e2a40816e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:42.875280 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a592586e-a25b-4eeb-80e8-67e2a40816e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:42.875942 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a592586e-a25b-4eeb-80e8-67e2a40816e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:42.877379 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a592586e-a25b-4eeb-80e8-67e2a40816e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:42.878250 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a592586e-a25b-4eeb-80e8-67e2a40816e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:43.038766 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a592586e-a25b-4eeb-80e8-67e2a40816e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:43.047654 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a592586e-a25b-4eeb-80e8-67e2a40816e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1564 microversion: 2.1 time: 0.190613 Jun 22 10:21:43.048977 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 237/483] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:42 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:43.065559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-49cb9381-649c-4f27-acf4-65d65d8776f4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:43.066665 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-49cb9381-649c-4f27-acf4-65d65d8776f4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:43.073609 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-49cb9381-649c-4f27-acf4-65d65d8776f4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:43.074427 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-49cb9381-649c-4f27-acf4-65d65d8776f4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:43.075411 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-49cb9381-649c-4f27-acf4-65d65d8776f4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:43.075855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-49cb9381-649c-4f27-acf4-65d65d8776f4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:43.169082 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-49cb9381-649c-4f27-acf4-65d65d8776f4 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108636 Jun 22 10:21:43.170019 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 247/484] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jun 22 10:21:43 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:44.728478 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-58242d0a-a990-40c4-a4f8-0bfca9abcac2 req-6d131f4c-a78d-43ac-9dff-343494af71de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6", "tag": "c91bf175-3a15-4ba3-8e3a-92fa06cf2063"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:44.738140 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-58242d0a-a990-40c4-a4f8-0bfca9abcac2 req-6d131f4c-a78d-43ac-9dff-343494af71de service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:44.738853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-58242d0a-a990-40c4-a4f8-0bfca9abcac2 req-6d131f4c-a78d-43ac-9dff-343494af71de service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:44.751157 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-58242d0a-a990-40c4-a4f8-0bfca9abcac2 req-6d131f4c-a78d-43ac-9dff-343494af71de service nova] Creating event network-changed:c91bf175-3a15-4ba3-8e3a-92fa06cf2063 for instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 on hv-cinder-84327 Jun 22 10:21:44.756776 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-58242d0a-a990-40c4-a4f8-0bfca9abcac2 req-6d131f4c-a78d-43ac-9dff-343494af71de service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032180 Jun 22 10:21:44.758003 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 238/485] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:57.985992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:21:57.986732 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Wed Jun 22 10:21:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:22:08.968111 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=13 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:08.970154 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=48 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:08.975433 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-33c4be1c-8b05-4d4e-a944-6feb26bb52d9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:08.979903 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-33c4be1c-8b05-4d4e-a944-6feb26bb52d9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:08.982451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-33c4be1c-8b05-4d4e-a944-6feb26bb52d9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:08.982815 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-33c4be1c-8b05-4d4e-a944-6feb26bb52d9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:08.983994 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-33c4be1c-8b05-4d4e-a944-6feb26bb52d9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:08.984584 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-33c4be1c-8b05-4d4e-a944-6feb26bb52d9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:09.022622 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-33c4be1c-8b05-4d4e-a944-6feb26bb52d9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/ips" status: 200 len: 144 microversion: 2.1 time: 0.055361 Jun 22 10:22:09.023198 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 248/486] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jun 22 10:22:08 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/ips => generated 144 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:12.897656 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a8eae89e-9901-4d37-be9d-a2eb57031696 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:12.898251 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a8eae89e-9901-4d37-be9d-a2eb57031696 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:12.900905 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=17 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:12.901764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=34 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:12.908023 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a8eae89e-9901-4d37-be9d-a2eb57031696 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:12.908568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a8eae89e-9901-4d37-be9d-a2eb57031696 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:12.909283 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a8eae89e-9901-4d37-be9d-a2eb57031696 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:12.909901 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a8eae89e-9901-4d37-be9d-a2eb57031696 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:12.940596 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a8eae89e-9901-4d37-be9d-a2eb57031696 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/ips" status: 200 len: 153 microversion: 2.20 time: 0.047557 Jun 22 10:22:12.941575 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 239/487] 10.222.0.46 () {60 vars in 1288 bytes} [Wed Jun 22 10:22:12 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/ips => generated 153 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:22:15.893559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7f2f77ce-316c-49d5-9928-08312d8adb5b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:15.894616 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7f2f77ce-316c-49d5-9928-08312d8adb5b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:15.903918 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7f2f77ce-316c-49d5-9928-08312d8adb5b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:15.904896 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7f2f77ce-316c-49d5-9928-08312d8adb5b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:15.906082 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7f2f77ce-316c-49d5-9928-08312d8adb5b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:15.906678 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7f2f77ce-316c-49d5-9928-08312d8adb5b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:15.946076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-7f2f77ce-316c-49d5-9928-08312d8adb5b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lazy-loading 'flavor' on Instance uuid 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:16.624622 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7f2f77ce-316c-49d5-9928-08312d8adb5b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "POST /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/action" status: 202 len: 0 microversion: 2.20 time: 0.735862 Jun 22 10:22:16.632778 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 249/488] 10.222.0.46 () {62 vars in 1318 bytes} [Wed Jun 22 10:22:15 2022] POST /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/action => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:22:16.636521 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9840f1a9-5ecd-4b7b-956e-78edeaf886d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:16.637706 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9840f1a9-5ecd-4b7b-956e-78edeaf886d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:16.651718 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9840f1a9-5ecd-4b7b-956e-78edeaf886d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:16.652376 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9840f1a9-5ecd-4b7b-956e-78edeaf886d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:16.654127 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9840f1a9-5ecd-4b7b-956e-78edeaf886d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:16.658187 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9840f1a9-5ecd-4b7b-956e-78edeaf886d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:16.848069 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9840f1a9-5ecd-4b7b-956e-78edeaf886d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:16.863363 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9840f1a9-5ecd-4b7b-956e-78edeaf886d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:16.869296 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9840f1a9-5ecd-4b7b-956e-78edeaf886d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:16.873024 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9840f1a9-5ecd-4b7b-956e-78edeaf886d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.242516 Jun 22 10:22:16.873809 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 240/489] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:16 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:17.272709 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-242ce380-e799-42a4-879d-25569e64ebf0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Action: 'create', calling method: .version_select at 0x7f021fe3be50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-861565459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1slPpgkmNlpVogFHEB1mpC59GQI15tty/3AZ8wCsXSe/o8BrdIHJUx2SU914Nj3OpUE5GaepMxANSHcz3voC8+e+UIiDz3Rc9lq3Zs/QKZEnWUpYvQZzURdU1tXty7LA=="}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:17.287503 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-242ce380-e799-42a4-879d-25569e64ebf0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Getting quotas for project abd71b49f6d9403b8cea1fd9e7680ffb. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:22:17.291525 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-242ce380-e799-42a4-879d-25569e64ebf0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Getting quotas for user 401fdd54d8a143a892fd2d2407a78bc5 and project abd71b49f6d9403b8cea1fd9e7680ffb. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:22:17.414686 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-242ce380-e799-42a4-879d-25569e64ebf0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.341900 Jun 22 10:22:17.415285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 250/490] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jun 22 10:22:17 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:17.894334 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-217bc48a-7c57-4438-acdc-ea05a80c2866 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:17.894963 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-217bc48a-7c57-4438-acdc-ea05a80c2866 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:17.901604 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-217bc48a-7c57-4438-acdc-ea05a80c2866 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:17.912330 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-217bc48a-7c57-4438-acdc-ea05a80c2866 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:17.912330 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-217bc48a-7c57-4438-acdc-ea05a80c2866 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:17.912330 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-217bc48a-7c57-4438-acdc-ea05a80c2866 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:18.098049 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-217bc48a-7c57-4438-acdc-ea05a80c2866 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:18.107282 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-217bc48a-7c57-4438-acdc-ea05a80c2866 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:18.109475 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-217bc48a-7c57-4438-acdc-ea05a80c2866 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:18.110962 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-217bc48a-7c57-4438-acdc-ea05a80c2866 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.221130 Jun 22 10:22:18.111636 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 241/491] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:17 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:19.129760 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9c768d07-9c4e-4832-8dd4-dd2eecc03864 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:19.130497 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9c768d07-9c4e-4832-8dd4-dd2eecc03864 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:19.136751 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9c768d07-9c4e-4832-8dd4-dd2eecc03864 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:19.137225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9c768d07-9c4e-4832-8dd4-dd2eecc03864 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:19.137974 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9c768d07-9c4e-4832-8dd4-dd2eecc03864 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:19.138402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9c768d07-9c4e-4832-8dd4-dd2eecc03864 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:19.294020 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9c768d07-9c4e-4832-8dd4-dd2eecc03864 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:19.305098 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9c768d07-9c4e-4832-8dd4-dd2eecc03864 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:19.306497 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9c768d07-9c4e-4832-8dd4-dd2eecc03864 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:19.307605 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9c768d07-9c4e-4832-8dd4-dd2eecc03864 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.182454 Jun 22 10:22:19.308365 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 251/492] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:19 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:20.326004 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2701c800-af0d-48bd-a6b3-2202de88ff36 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:20.327249 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2701c800-af0d-48bd-a6b3-2202de88ff36 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:20.335240 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2701c800-af0d-48bd-a6b3-2202de88ff36 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:20.335687 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2701c800-af0d-48bd-a6b3-2202de88ff36 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:20.336462 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2701c800-af0d-48bd-a6b3-2202de88ff36 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:20.336934 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2701c800-af0d-48bd-a6b3-2202de88ff36 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:20.492107 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2701c800-af0d-48bd-a6b3-2202de88ff36 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:20.500974 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2701c800-af0d-48bd-a6b3-2202de88ff36 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:20.502992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2701c800-af0d-48bd-a6b3-2202de88ff36 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:20.504174 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2701c800-af0d-48bd-a6b3-2202de88ff36 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.182297 Jun 22 10:22:20.505143 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 242/493] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:20 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:21.522304 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2d86fd06-78cf-4074-96f4-fc0ed8f91359 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:21.523076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2d86fd06-78cf-4074-96f4-fc0ed8f91359 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:21.529242 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d86fd06-78cf-4074-96f4-fc0ed8f91359 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:21.529982 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d86fd06-78cf-4074-96f4-fc0ed8f91359 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:21.530747 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d86fd06-78cf-4074-96f4-fc0ed8f91359 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:21.531238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d86fd06-78cf-4074-96f4-fc0ed8f91359 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:21.670381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2d86fd06-78cf-4074-96f4-fc0ed8f91359 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:21.678940 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2d86fd06-78cf-4074-96f4-fc0ed8f91359 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:21.680474 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2d86fd06-78cf-4074-96f4-fc0ed8f91359 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:21.681667 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2d86fd06-78cf-4074-96f4-fc0ed8f91359 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.163369 Jun 22 10:22:21.682216 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 252/494] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:21 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:22:21.739856 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f7668830-ca49-42db-b2d2-a32414e88216 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91b35dc5-ff09-4dce-8df2-3cd7d9914e8f"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:21.740962 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f7668830-ca49-42db-b2d2-a32414e88216 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:21.747511 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f7668830-ca49-42db-b2d2-a32414e88216 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:21.747963 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f7668830-ca49-42db-b2d2-a32414e88216 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:21.748745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f7668830-ca49-42db-b2d2-a32414e88216 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:21.749265 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f7668830-ca49-42db-b2d2-a32414e88216 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:22.700941 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f9b7d75e-1e62-4d05-b26d-eef0268b6c33 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:22.701799 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f9b7d75e-1e62-4d05-b26d-eef0268b6c33 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:22.708148 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f9b7d75e-1e62-4d05-b26d-eef0268b6c33 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:22.708596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f9b7d75e-1e62-4d05-b26d-eef0268b6c33 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:22.709400 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f9b7d75e-1e62-4d05-b26d-eef0268b6c33 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:22.709835 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f9b7d75e-1e62-4d05-b26d-eef0268b6c33 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:22.746625 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f7668830-ca49-42db-b2d2-a32414e88216 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "POST /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.010393 Jun 22 10:22:22.747402 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 243/495] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:22:21 2022] POST /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/os-volume_attachments => generated 194 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:22.864523 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f9b7d75e-1e62-4d05-b26d-eef0268b6c33 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:22.872854 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f9b7d75e-1e62-4d05-b26d-eef0268b6c33 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:22.874367 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f9b7d75e-1e62-4d05-b26d-eef0268b6c33 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:22.875511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f9b7d75e-1e62-4d05-b26d-eef0268b6c33 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.178658 Jun 22 10:22:22.876164 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 253/496] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:22 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:22:23.896372 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b11ade40-dd92-4c8e-a42b-09325f2b8e7a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:23.897204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b11ade40-dd92-4c8e-a42b-09325f2b8e7a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:23.903586 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b11ade40-dd92-4c8e-a42b-09325f2b8e7a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:23.904264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b11ade40-dd92-4c8e-a42b-09325f2b8e7a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:23.904800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b11ade40-dd92-4c8e-a42b-09325f2b8e7a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:23.905518 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b11ade40-dd92-4c8e-a42b-09325f2b8e7a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:24.037841 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b11ade40-dd92-4c8e-a42b-09325f2b8e7a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:24.045909 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b11ade40-dd92-4c8e-a42b-09325f2b8e7a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:24.047424 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b11ade40-dd92-4c8e-a42b-09325f2b8e7a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:24.049230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b11ade40-dd92-4c8e-a42b-09325f2b8e7a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.157911 Jun 22 10:22:24.049786 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 244/497] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:23 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:22:25.067902 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6618db9d-e29d-4c0b-8fb3-3eab0a4903aa tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:25.068649 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6618db9d-e29d-4c0b-8fb3-3eab0a4903aa tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:25.074837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6618db9d-e29d-4c0b-8fb3-3eab0a4903aa tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:25.075286 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6618db9d-e29d-4c0b-8fb3-3eab0a4903aa tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:25.076076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6618db9d-e29d-4c0b-8fb3-3eab0a4903aa tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:25.076489 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6618db9d-e29d-4c0b-8fb3-3eab0a4903aa tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:25.213412 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6618db9d-e29d-4c0b-8fb3-3eab0a4903aa tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:25.222011 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6618db9d-e29d-4c0b-8fb3-3eab0a4903aa tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:25.223585 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6618db9d-e29d-4c0b-8fb3-3eab0a4903aa tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:25.224806 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6618db9d-e29d-4c0b-8fb3-3eab0a4903aa tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.161405 Jun 22 10:22:25.225409 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 254/498] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:25 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:26.243495 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a6c729fc-c0c9-40ad-a601-f9c93be5688f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:26.244103 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a6c729fc-c0c9-40ad-a601-f9c93be5688f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:26.250649 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a6c729fc-c0c9-40ad-a601-f9c93be5688f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:26.251101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a6c729fc-c0c9-40ad-a601-f9c93be5688f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:26.251908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a6c729fc-c0c9-40ad-a601-f9c93be5688f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:26.252346 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a6c729fc-c0c9-40ad-a601-f9c93be5688f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:26.380457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a6c729fc-c0c9-40ad-a601-f9c93be5688f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:26.388859 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a6c729fc-c0c9-40ad-a601-f9c93be5688f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:26.390361 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a6c729fc-c0c9-40ad-a601-f9c93be5688f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:26.391539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a6c729fc-c0c9-40ad-a601-f9c93be5688f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.151968 Jun 22 10:22:26.392081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 245/499] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:26 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:27.409119 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-08eb6ce8-732c-4411-9d3e-cc165c442b94 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:27.409757 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-08eb6ce8-732c-4411-9d3e-cc165c442b94 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:27.411771 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=4 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:27.416744 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-08eb6ce8-732c-4411-9d3e-cc165c442b94 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:27.420523 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-08eb6ce8-732c-4411-9d3e-cc165c442b94 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:27.420523 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-08eb6ce8-732c-4411-9d3e-cc165c442b94 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:27.420523 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-08eb6ce8-732c-4411-9d3e-cc165c442b94 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:27.552414 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-08eb6ce8-732c-4411-9d3e-cc165c442b94 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:27.560376 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-08eb6ce8-732c-4411-9d3e-cc165c442b94 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:27.561918 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-08eb6ce8-732c-4411-9d3e-cc165c442b94 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:27.563086 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-08eb6ce8-732c-4411-9d3e-cc165c442b94 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.158238 Jun 22 10:22:27.563644 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 255/500] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:27 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:28.581635 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ea02db10-57f8-418c-92e7-682d9a2a52dd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:28.582247 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ea02db10-57f8-418c-92e7-682d9a2a52dd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:28.589610 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ea02db10-57f8-418c-92e7-682d9a2a52dd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:28.590287 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ea02db10-57f8-418c-92e7-682d9a2a52dd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:28.591067 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ea02db10-57f8-418c-92e7-682d9a2a52dd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:28.591507 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ea02db10-57f8-418c-92e7-682d9a2a52dd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:28.737703 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ea02db10-57f8-418c-92e7-682d9a2a52dd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:28.748016 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ea02db10-57f8-418c-92e7-682d9a2a52dd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:28.749776 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ea02db10-57f8-418c-92e7-682d9a2a52dd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:28.750751 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ea02db10-57f8-418c-92e7-682d9a2a52dd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.173037 Jun 22 10:22:28.751648 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 246/501] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:28 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:29.772129 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c924aac6-4ca8-4b93-a547-3a442d6ff55e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:29.772743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c924aac6-4ca8-4b93-a547-3a442d6ff55e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:29.779142 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c924aac6-4ca8-4b93-a547-3a442d6ff55e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:29.779787 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c924aac6-4ca8-4b93-a547-3a442d6ff55e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:29.780813 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c924aac6-4ca8-4b93-a547-3a442d6ff55e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:29.781275 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c924aac6-4ca8-4b93-a547-3a442d6ff55e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:29.954291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c924aac6-4ca8-4b93-a547-3a442d6ff55e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:29.963266 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c924aac6-4ca8-4b93-a547-3a442d6ff55e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:29.966570 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c924aac6-4ca8-4b93-a547-3a442d6ff55e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:29.966570 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c924aac6-4ca8-4b93-a547-3a442d6ff55e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.198804 Jun 22 10:22:29.967248 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 256/502] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:29 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:30.985678 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7ac88563-9b60-4079-97e7-8e1b5c02e072 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:30.986291 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7ac88563-9b60-4079-97e7-8e1b5c02e072 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:30.993419 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7ac88563-9b60-4079-97e7-8e1b5c02e072 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:30.993866 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7ac88563-9b60-4079-97e7-8e1b5c02e072 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:30.994629 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7ac88563-9b60-4079-97e7-8e1b5c02e072 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:30.995091 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7ac88563-9b60-4079-97e7-8e1b5c02e072 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:31.130989 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7ac88563-9b60-4079-97e7-8e1b5c02e072 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:31.138860 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7ac88563-9b60-4079-97e7-8e1b5c02e072 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:31.140369 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7ac88563-9b60-4079-97e7-8e1b5c02e072 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:31.141576 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7ac88563-9b60-4079-97e7-8e1b5c02e072 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.160567 Jun 22 10:22:31.142138 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 247/503] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:30 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:32.160297 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1d40419b-2893-4761-bd0e-2ff177222a0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:32.160886 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1d40419b-2893-4761-bd0e-2ff177222a0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:32.166975 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1d40419b-2893-4761-bd0e-2ff177222a0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:32.167423 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1d40419b-2893-4761-bd0e-2ff177222a0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:32.168188 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1d40419b-2893-4761-bd0e-2ff177222a0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:32.168626 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1d40419b-2893-4761-bd0e-2ff177222a0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:32.301844 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1d40419b-2893-4761-bd0e-2ff177222a0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:32.307808 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1d40419b-2893-4761-bd0e-2ff177222a0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:32.309574 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1d40419b-2893-4761-bd0e-2ff177222a0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:32.310747 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1d40419b-2893-4761-bd0e-2ff177222a0d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.155291 Jun 22 10:22:32.311309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 257/504] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:32 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:33.328871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a6734b74-b0d7-459d-979d-aa412d040d77 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:33.329473 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a6734b74-b0d7-459d-979d-aa412d040d77 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:33.336050 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a6734b74-b0d7-459d-979d-aa412d040d77 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:33.336500 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a6734b74-b0d7-459d-979d-aa412d040d77 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:33.337300 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a6734b74-b0d7-459d-979d-aa412d040d77 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:33.337756 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a6734b74-b0d7-459d-979d-aa412d040d77 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:33.477603 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a6734b74-b0d7-459d-979d-aa412d040d77 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:33.485499 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a6734b74-b0d7-459d-979d-aa412d040d77 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:33.487659 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a6734b74-b0d7-459d-979d-aa412d040d77 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:33.488957 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a6734b74-b0d7-459d-979d-aa412d040d77 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.163961 Jun 22 10:22:33.489752 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 248/505] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:33 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:34.509272 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-77d2a3f8-8f5f-41db-a0ab-120e5913dec5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:34.509869 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-77d2a3f8-8f5f-41db-a0ab-120e5913dec5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:34.515952 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77d2a3f8-8f5f-41db-a0ab-120e5913dec5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:34.516391 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77d2a3f8-8f5f-41db-a0ab-120e5913dec5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:34.517182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77d2a3f8-8f5f-41db-a0ab-120e5913dec5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:34.517621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77d2a3f8-8f5f-41db-a0ab-120e5913dec5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:34.654142 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-77d2a3f8-8f5f-41db-a0ab-120e5913dec5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:34.663075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-77d2a3f8-8f5f-41db-a0ab-120e5913dec5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:34.664584 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-77d2a3f8-8f5f-41db-a0ab-120e5913dec5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:34.665802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-77d2a3f8-8f5f-41db-a0ab-120e5913dec5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.160615 Jun 22 10:22:34.666366 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 258/506] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:34 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:35.683528 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d3eceef9-c7e4-4373-92d0-973397c8c146 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:35.684142 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d3eceef9-c7e4-4373-92d0-973397c8c146 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:35.691306 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d3eceef9-c7e4-4373-92d0-973397c8c146 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:35.691748 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d3eceef9-c7e4-4373-92d0-973397c8c146 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:35.692534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d3eceef9-c7e4-4373-92d0-973397c8c146 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:35.692993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d3eceef9-c7e4-4373-92d0-973397c8c146 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:35.828724 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d3eceef9-c7e4-4373-92d0-973397c8c146 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:35.839408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d3eceef9-c7e4-4373-92d0-973397c8c146 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:35.841965 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d3eceef9-c7e4-4373-92d0-973397c8c146 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:35.843601 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d3eceef9-c7e4-4373-92d0-973397c8c146 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.164073 Jun 22 10:22:35.844156 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 249/507] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:35 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:36.863170 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-82f6543d-c4fd-47a9-825a-e282dc548602 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:36.863886 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-82f6543d-c4fd-47a9-825a-e282dc548602 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:36.870912 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82f6543d-c4fd-47a9-825a-e282dc548602 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:36.871460 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82f6543d-c4fd-47a9-825a-e282dc548602 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:36.872347 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82f6543d-c4fd-47a9-825a-e282dc548602 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:36.872867 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82f6543d-c4fd-47a9-825a-e282dc548602 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:37.011038 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-82f6543d-c4fd-47a9-825a-e282dc548602 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:37.019454 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-82f6543d-c4fd-47a9-825a-e282dc548602 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:37.021022 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-82f6543d-c4fd-47a9-825a-e282dc548602 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:37.022161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-82f6543d-c4fd-47a9-825a-e282dc548602 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.163543 Jun 22 10:22:37.023121 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 259/508] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:36 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:37.676012 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-df09b788-e980-4047-bba4-04dacb50143e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:37.682662 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-df09b788-e980-4047-bba4-04dacb50143e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:37.683115 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-df09b788-e980-4047-bba4-04dacb50143e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:37.744268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-df09b788-e980-4047-bba4-04dacb50143e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Going to try to stop instance {{(pid=118327) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 10:22:38.016027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-df09b788-e980-4047-bba4-04dacb50143e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "POST /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/action" status: 202 len: 0 microversion: 2.1 time: 0.343891 Jun 22 10:22:38.016636 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 250/509] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:22:37 2022] POST /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:22:38.025513 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-81aea52a-16f8-42e1-b45f-8370f89d822f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:38.026129 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-81aea52a-16f8-42e1-b45f-8370f89d822f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:38.032436 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-81aea52a-16f8-42e1-b45f-8370f89d822f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:38.032936 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-81aea52a-16f8-42e1-b45f-8370f89d822f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:38.033717 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-81aea52a-16f8-42e1-b45f-8370f89d822f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:38.034151 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-81aea52a-16f8-42e1-b45f-8370f89d822f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:38.041703 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-143e8a0f-7191-4480-b751-3a5d70e02bb9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:38.042800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-143e8a0f-7191-4480-b751-3a5d70e02bb9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:38.066809 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-143e8a0f-7191-4480-b751-3a5d70e02bb9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:38.067256 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-143e8a0f-7191-4480-b751-3a5d70e02bb9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:38.068051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-143e8a0f-7191-4480-b751-3a5d70e02bb9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:38.068440 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-143e8a0f-7191-4480-b751-3a5d70e02bb9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:38.235901 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-81aea52a-16f8-42e1-b45f-8370f89d822f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:38.250088 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-81aea52a-16f8-42e1-b45f-8370f89d822f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1722 microversion: 2.1 time: 0.228466 Jun 22 10:22:38.250828 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 260/510] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:38 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:38.278286 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-143e8a0f-7191-4480-b751-3a5d70e02bb9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:38.287145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-143e8a0f-7191-4480-b751-3a5d70e02bb9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:38.288653 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-143e8a0f-7191-4480-b751-3a5d70e02bb9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:38.289838 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-143e8a0f-7191-4480-b751-3a5d70e02bb9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.252782 Jun 22 10:22:38.290398 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 251/511] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:38 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:22:39.267514 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-264fc110-cafb-45c1-ba2a-bec0dc7ec230 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:39.268678 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-264fc110-cafb-45c1-ba2a-bec0dc7ec230 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:39.274924 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-264fc110-cafb-45c1-ba2a-bec0dc7ec230 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:39.275303 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-264fc110-cafb-45c1-ba2a-bec0dc7ec230 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:39.276079 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-264fc110-cafb-45c1-ba2a-bec0dc7ec230 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:39.276515 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-264fc110-cafb-45c1-ba2a-bec0dc7ec230 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:39.309287 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-23ed3dcf-4311-4e0d-9b31-1f47e475e2cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:39.310697 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-23ed3dcf-4311-4e0d-9b31-1f47e475e2cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:39.322464 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-23ed3dcf-4311-4e0d-9b31-1f47e475e2cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:39.322464 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-23ed3dcf-4311-4e0d-9b31-1f47e475e2cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:39.322464 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-23ed3dcf-4311-4e0d-9b31-1f47e475e2cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:39.322464 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-23ed3dcf-4311-4e0d-9b31-1f47e475e2cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:39.466293 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-264fc110-cafb-45c1-ba2a-bec0dc7ec230 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:39.481097 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-264fc110-cafb-45c1-ba2a-bec0dc7ec230 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1722 microversion: 2.1 time: 0.217281 Jun 22 10:22:39.482669 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 261/512] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:39 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:39.503590 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-23ed3dcf-4311-4e0d-9b31-1f47e475e2cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:39.513171 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-23ed3dcf-4311-4e0d-9b31-1f47e475e2cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:39.514960 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-23ed3dcf-4311-4e0d-9b31-1f47e475e2cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:39.517295 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-23ed3dcf-4311-4e0d-9b31-1f47e475e2cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.212529 Jun 22 10:22:39.523443 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 252/513] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:39 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:22:40.499476 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4ae5aba2-7a5f-4dc4-9409-0887ccd249fa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:40.500790 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4ae5aba2-7a5f-4dc4-9409-0887ccd249fa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:40.508123 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4ae5aba2-7a5f-4dc4-9409-0887ccd249fa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:40.508575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4ae5aba2-7a5f-4dc4-9409-0887ccd249fa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:40.509383 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4ae5aba2-7a5f-4dc4-9409-0887ccd249fa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:40.509822 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4ae5aba2-7a5f-4dc4-9409-0887ccd249fa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:40.535975 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-48ea2bf8-4faf-487e-a907-8c81e482df55 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:40.536588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-48ea2bf8-4faf-487e-a907-8c81e482df55 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:40.543129 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-48ea2bf8-4faf-487e-a907-8c81e482df55 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:40.543581 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-48ea2bf8-4faf-487e-a907-8c81e482df55 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:40.544368 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-48ea2bf8-4faf-487e-a907-8c81e482df55 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:40.544801 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-48ea2bf8-4faf-487e-a907-8c81e482df55 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:40.596249 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:40.769859 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4ae5aba2-7a5f-4dc4-9409-0887ccd249fa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:40.781571 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4ae5aba2-7a5f-4dc4-9409-0887ccd249fa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1722 microversion: 2.1 time: 0.286019 Jun 22 10:22:40.791754 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 262/514] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:40 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:40.799120 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-48ea2bf8-4faf-487e-a907-8c81e482df55 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:40.808082 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-48ea2bf8-4faf-487e-a907-8c81e482df55 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:40.809969 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-48ea2bf8-4faf-487e-a907-8c81e482df55 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:40.811408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-48ea2bf8-4faf-487e-a907-8c81e482df55 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.279528 Jun 22 10:22:40.812045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 253/515] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:40 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:41.800512 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b2779d14-bfa7-444f-9d33-f4c794c8f4a8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:41.801150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b2779d14-bfa7-444f-9d33-f4c794c8f4a8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:41.808903 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b2779d14-bfa7-444f-9d33-f4c794c8f4a8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:41.809350 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b2779d14-bfa7-444f-9d33-f4c794c8f4a8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:41.810119 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b2779d14-bfa7-444f-9d33-f4c794c8f4a8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:41.810548 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b2779d14-bfa7-444f-9d33-f4c794c8f4a8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:41.830677 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9bd96110-42a7-46f0-983c-5b1efbf016b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:41.831147 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9bd96110-42a7-46f0-983c-5b1efbf016b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:41.847400 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9bd96110-42a7-46f0-983c-5b1efbf016b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:41.847849 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9bd96110-42a7-46f0-983c-5b1efbf016b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:41.848620 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9bd96110-42a7-46f0-983c-5b1efbf016b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:41.853706 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9bd96110-42a7-46f0-983c-5b1efbf016b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:42.142068 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b2779d14-bfa7-444f-9d33-f4c794c8f4a8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:42.147610 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9bd96110-42a7-46f0-983c-5b1efbf016b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:42.157981 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9bd96110-42a7-46f0-983c-5b1efbf016b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:42.158876 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:42.160134 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9bd96110-42a7-46f0-983c-5b1efbf016b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:42.161375 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9bd96110-42a7-46f0-983c-5b1efbf016b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.335363 Jun 22 10:22:42.161946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 254/516] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:41 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:22:42.173953 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b2779d14-bfa7-444f-9d33-f4c794c8f4a8 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1722 microversion: 2.1 time: 0.376226 Jun 22 10:22:42.173953 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 263/517] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:41 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:43.180687 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cea3854b-d6c6-4c52-acc7-9adb744d94e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:43.181342 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-cea3854b-d6c6-4c52-acc7-9adb744d94e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:43.189734 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2b171160-277f-45c4-837d-e8bcb45343f6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:43.190318 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2b171160-277f-45c4-837d-e8bcb45343f6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:43.191304 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cea3854b-d6c6-4c52-acc7-9adb744d94e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:43.191762 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cea3854b-d6c6-4c52-acc7-9adb744d94e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:43.193032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cea3854b-d6c6-4c52-acc7-9adb744d94e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:43.193468 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cea3854b-d6c6-4c52-acc7-9adb744d94e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:43.200461 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2b171160-277f-45c4-837d-e8bcb45343f6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:43.201587 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2b171160-277f-45c4-837d-e8bcb45343f6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:43.202881 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2b171160-277f-45c4-837d-e8bcb45343f6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:43.203545 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2b171160-277f-45c4-837d-e8bcb45343f6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:43.488396 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cea3854b-d6c6-4c52-acc7-9adb744d94e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:43.495269 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2b171160-277f-45c4-837d-e8bcb45343f6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:43.507848 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2b171160-277f-45c4-837d-e8bcb45343f6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1722 microversion: 2.1 time: 0.321813 Jun 22 10:22:43.508601 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 264/518] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:43 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:43.508945 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cea3854b-d6c6-4c52-acc7-9adb744d94e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:43.510686 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cea3854b-d6c6-4c52-acc7-9adb744d94e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:43.512035 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cea3854b-d6c6-4c52-acc7-9adb744d94e1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1746 microversion: 2.20 time: 0.335239 Jun 22 10:22:43.528344 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 255/519] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:43 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1746 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:44.525229 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f8025cb0-f5fc-4d69-8f1f-0bdd01a77666 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:44.525838 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f8025cb0-f5fc-4d69-8f1f-0bdd01a77666 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:44.533071 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f8025cb0-f5fc-4d69-8f1f-0bdd01a77666 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:44.533518 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f8025cb0-f5fc-4d69-8f1f-0bdd01a77666 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:44.534420 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f8025cb0-f5fc-4d69-8f1f-0bdd01a77666 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:44.534857 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f8025cb0-f5fc-4d69-8f1f-0bdd01a77666 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:44.547174 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2beb2485-8c6d-4fd6-ba89-e36658d75d28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:44.547935 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2beb2485-8c6d-4fd6-ba89-e36658d75d28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:44.554974 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2beb2485-8c6d-4fd6-ba89-e36658d75d28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:44.555429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2beb2485-8c6d-4fd6-ba89-e36658d75d28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:44.556209 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2beb2485-8c6d-4fd6-ba89-e36658d75d28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:44.556643 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2beb2485-8c6d-4fd6-ba89-e36658d75d28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:44.819571 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f8025cb0-f5fc-4d69-8f1f-0bdd01a77666 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:44.828012 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f8025cb0-f5fc-4d69-8f1f-0bdd01a77666 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1722 microversion: 2.1 time: 0.306721 Jun 22 10:22:44.828835 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 265/520] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:44 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1722 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:44.850051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2beb2485-8c6d-4fd6-ba89-e36658d75d28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:44.860184 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2beb2485-8c6d-4fd6-ba89-e36658d75d28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:44.861946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2beb2485-8c6d-4fd6-ba89-e36658d75d28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:44.864138 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2beb2485-8c6d-4fd6-ba89-e36658d75d28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1746 microversion: 2.20 time: 0.320698 Jun 22 10:22:44.865394 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 256/521] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:44 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1746 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:22:45.845588 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-dd863d12-e626-4c29-8d7c-1933f1683a83 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:45.846856 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-dd863d12-e626-4c29-8d7c-1933f1683a83 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:45.853980 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dd863d12-e626-4c29-8d7c-1933f1683a83 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:45.854562 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dd863d12-e626-4c29-8d7c-1933f1683a83 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:45.855427 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dd863d12-e626-4c29-8d7c-1933f1683a83 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:45.855982 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dd863d12-e626-4c29-8d7c-1933f1683a83 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:45.888424 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-df8a3652-66da-4a03-8222-dd06ac176c54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:45.889305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-df8a3652-66da-4a03-8222-dd06ac176c54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:45.900159 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-df8a3652-66da-4a03-8222-dd06ac176c54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:45.901481 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-df8a3652-66da-4a03-8222-dd06ac176c54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:45.902777 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-df8a3652-66da-4a03-8222-dd06ac176c54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:45.903528 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-df8a3652-66da-4a03-8222-dd06ac176c54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:46.231517 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-dd863d12-e626-4c29-8d7c-1933f1683a83 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:46.241410 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-df8a3652-66da-4a03-8222-dd06ac176c54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:46.254138 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-df8a3652-66da-4a03-8222-dd06ac176c54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:46.254138 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-df8a3652-66da-4a03-8222-dd06ac176c54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:46.254138 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-df8a3652-66da-4a03-8222-dd06ac176c54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1746 microversion: 2.20 time: 0.372964 Jun 22 10:22:46.254546 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 257/522] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:45 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1746 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:22:46.257807 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-dd863d12-e626-4c29-8d7c-1933f1683a83 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1722 microversion: 2.1 time: 0.416109 Jun 22 10:22:46.258381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 266/523] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:45 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1722 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:46.900621 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-1c949299-ad4f-488f-8761-9f4d3d2ea01c req-11b6752b-bb44-4cfe-9331-48fc5f3cad4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fa8c96-e39d-47ce-86a0-9d7d7eaf099f", "name": "network-vif-plugged", "status": "completed", "tag": "9c2ee9e8-f445-4686-bacb-0cbc5c3c71de"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:46.905591 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=39 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:46.911816 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-1c949299-ad4f-488f-8761-9f4d3d2ea01c req-11b6752b-bb44-4cfe-9331-48fc5f3cad4d service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:46.912263 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-1c949299-ad4f-488f-8761-9f4d3d2ea01c req-11b6752b-bb44-4cfe-9331-48fc5f3cad4d service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:46.928946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-1c949299-ad4f-488f-8761-9f4d3d2ea01c req-11b6752b-bb44-4cfe-9331-48fc5f3cad4d service nova] Creating event network-vif-plugged:9c2ee9e8-f445-4686-bacb-0cbc5c3c71de for instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f on hv-cinder-84327 Jun 22 10:22:46.934738 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-1c949299-ad4f-488f-8761-9f4d3d2ea01c req-11b6752b-bb44-4cfe-9331-48fc5f3cad4d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037957 Jun 22 10:22:46.935739 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 258/524] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:47.272452 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f7cbaacb-f361-45f7-a6e4-d8f009acf196 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:47.273209 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f7cbaacb-f361-45f7-a6e4-d8f009acf196 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:47.275186 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:47.276850 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-818aa342-e2a7-4020-998a-79e8f7bc92be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:47.277541 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-818aa342-e2a7-4020-998a-79e8f7bc92be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:47.280380 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f7cbaacb-f361-45f7-a6e4-d8f009acf196 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:47.281206 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f7cbaacb-f361-45f7-a6e4-d8f009acf196 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:47.282466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f7cbaacb-f361-45f7-a6e4-d8f009acf196 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:47.283128 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f7cbaacb-f361-45f7-a6e4-d8f009acf196 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:47.288604 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-818aa342-e2a7-4020-998a-79e8f7bc92be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:47.289090 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-818aa342-e2a7-4020-998a-79e8f7bc92be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:47.290078 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-818aa342-e2a7-4020-998a-79e8f7bc92be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:47.290684 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-818aa342-e2a7-4020-998a-79e8f7bc92be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:47.521653 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f7cbaacb-f361-45f7-a6e4-d8f009acf196 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:47.535472 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f7cbaacb-f361-45f7-a6e4-d8f009acf196 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:47.537448 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f7cbaacb-f361-45f7-a6e4-d8f009acf196 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:47.539265 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f7cbaacb-f361-45f7-a6e4-d8f009acf196 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1746 microversion: 2.20 time: 0.271449 Jun 22 10:22:47.551199 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-818aa342-e2a7-4020-998a-79e8f7bc92be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:47.551860 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 267/525] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:47 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1746 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:47.555999 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-818aa342-e2a7-4020-998a-79e8f7bc92be tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1722 microversion: 2.1 time: 0.283886 Jun 22 10:22:47.556656 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 259/526] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:47 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:48.558311 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9397f61b-ef8c-41a1-97aa-cbfc4297ab7c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:48.558929 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9397f61b-ef8c-41a1-97aa-cbfc4297ab7c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:48.565447 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9397f61b-ef8c-41a1-97aa-cbfc4297ab7c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:48.565926 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9397f61b-ef8c-41a1-97aa-cbfc4297ab7c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:48.566702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9397f61b-ef8c-41a1-97aa-cbfc4297ab7c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:48.567139 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9397f61b-ef8c-41a1-97aa-cbfc4297ab7c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:48.578868 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9c6894a4-c490-42f5-b952-8804af94fdb6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:48.579480 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9c6894a4-c490-42f5-b952-8804af94fdb6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:48.587197 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9c6894a4-c490-42f5-b952-8804af94fdb6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:48.587642 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9c6894a4-c490-42f5-b952-8804af94fdb6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:48.596665 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9c6894a4-c490-42f5-b952-8804af94fdb6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:48.596665 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9c6894a4-c490-42f5-b952-8804af94fdb6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:48.791174 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9397f61b-ef8c-41a1-97aa-cbfc4297ab7c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:48.801276 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9c6894a4-c490-42f5-b952-8804af94fdb6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:48.809822 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9c6894a4-c490-42f5-b952-8804af94fdb6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1722 microversion: 2.1 time: 0.234695 Jun 22 10:22:48.811754 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 260/527] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:48 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:48.822104 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9397f61b-ef8c-41a1-97aa-cbfc4297ab7c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:48.822104 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9397f61b-ef8c-41a1-97aa-cbfc4297ab7c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:48.822104 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9397f61b-ef8c-41a1-97aa-cbfc4297ab7c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1746 microversion: 2.20 time: 0.263520 Jun 22 10:22:48.837273 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 268/528] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:48 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1746 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:49.831858 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-98bafda0-8134-4ad0-bd74-19341e76d318 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:49.833110 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-98bafda0-8134-4ad0-bd74-19341e76d318 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:49.836600 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b08e57bc-0d17-4328-8045-7bfa87ec15f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:49.837237 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b08e57bc-0d17-4328-8045-7bfa87ec15f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:49.845261 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-98bafda0-8134-4ad0-bd74-19341e76d318 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:49.845957 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-98bafda0-8134-4ad0-bd74-19341e76d318 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:49.847689 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-98bafda0-8134-4ad0-bd74-19341e76d318 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:49.848364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-98bafda0-8134-4ad0-bd74-19341e76d318 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:49.849304 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b08e57bc-0d17-4328-8045-7bfa87ec15f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:49.850846 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b08e57bc-0d17-4328-8045-7bfa87ec15f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:49.850846 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b08e57bc-0d17-4328-8045-7bfa87ec15f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:49.851052 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b08e57bc-0d17-4328-8045-7bfa87ec15f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:50.104296 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-98bafda0-8134-4ad0-bd74-19341e76d318 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:50.115104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-98bafda0-8134-4ad0-bd74-19341e76d318 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1722 microversion: 2.1 time: 0.290021 Jun 22 10:22:50.116226 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 261/529] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:49 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:50.125638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b08e57bc-0d17-4328-8045-7bfa87ec15f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:50.141338 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b08e57bc-0d17-4328-8045-7bfa87ec15f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:50.143114 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b08e57bc-0d17-4328-8045-7bfa87ec15f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:50.145171 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b08e57bc-0d17-4328-8045-7bfa87ec15f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1746 microversion: 2.20 time: 0.312660 Jun 22 10:22:50.145753 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 269/530] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:49 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1746 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:51.161794 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-20927635-ebb5-4dbf-858e-d7f4eda0618a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:51.172454 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-20927635-ebb5-4dbf-858e-d7f4eda0618a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:51.186848 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-06e01270-80c5-473d-b39c-b282a8cee58d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:51.188287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-06e01270-80c5-473d-b39c-b282a8cee58d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:51.189388 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-20927635-ebb5-4dbf-858e-d7f4eda0618a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:51.191875 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-20927635-ebb5-4dbf-858e-d7f4eda0618a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:51.193066 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-20927635-ebb5-4dbf-858e-d7f4eda0618a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:51.194698 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-20927635-ebb5-4dbf-858e-d7f4eda0618a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:51.197473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06e01270-80c5-473d-b39c-b282a8cee58d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:51.198103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06e01270-80c5-473d-b39c-b282a8cee58d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:51.199490 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06e01270-80c5-473d-b39c-b282a8cee58d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:51.200544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06e01270-80c5-473d-b39c-b282a8cee58d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:51.539098 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-20927635-ebb5-4dbf-858e-d7f4eda0618a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:51.549868 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-20927635-ebb5-4dbf-858e-d7f4eda0618a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1722 microversion: 2.1 time: 0.411868 Jun 22 10:22:51.568489 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 262/531] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:51 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1722 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:51.573652 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1188967885", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-861565459", "security_groups": [{"name": "tempest-secgroup-smoke-1809832332"}], "block_device_mapping_v2": [{"uuid": "94bcee82-398a-417f-a2ff-972b52654b54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d0645bff-6cba-4d07-864e-88eb84ff97aa"}]}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:51.597254 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-06e01270-80c5-473d-b39c-b282a8cee58d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:51.611435 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-06e01270-80c5-473d-b39c-b282a8cee58d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:51.613632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-06e01270-80c5-473d-b39c-b282a8cee58d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:51.624383 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-06e01270-80c5-473d-b39c-b282a8cee58d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1746 microversion: 2.20 time: 0.452880 Jun 22 10:22:51.625503 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 270/532] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:51 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1746 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:51.730937 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.network.neutron [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] validate_networks() for [('d0645bff-6cba-4d07-864e-88eb84ff97aa', None, None, None, None, None)] {{(pid=118327) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:22:52.210418 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Flavor limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:22:52.211065 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Image limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:22:52.211522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Flavor pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:22:52.217332 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Image pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:22:52.217332 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:22:52.232488 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:52.232988 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:52.233888 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:52.234427 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:52.262547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Getting quotas for project abd71b49f6d9403b8cea1fd9e7680ffb. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:22:52.268164 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Getting quotas for user 401fdd54d8a143a892fd2d2407a78bc5 and project abd71b49f6d9403b8cea1fd9e7680ffb. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:22:52.356671 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Going to run 1 instances... {{(pid=118327) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:22:52.358782 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94bcee82-398a-417f-a2ff-972b52654b54',volume_size=None,volume_type=None)] {{(pid=118327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:22:52.574170 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ede48470-e7d8-459b-bf1b-cd61d4c004c2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:52.574754 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ede48470-e7d8-459b-bf1b-cd61d4c004c2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:52.582766 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ede48470-e7d8-459b-bf1b-cd61d4c004c2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:52.582766 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ede48470-e7d8-459b-bf1b-cd61d4c004c2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:52.582766 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ede48470-e7d8-459b-bf1b-cd61d4c004c2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:52.583154 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ede48470-e7d8-459b-bf1b-cd61d4c004c2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:52.761601 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ede48470-e7d8-459b-bf1b-cd61d4c004c2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:52.770630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ede48470-e7d8-459b-bf1b-cd61d4c004c2 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1722 microversion: 2.1 time: 0.200172 Jun 22 10:22:52.776535 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 271/533] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:52 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:52.785784 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e46a9f9b-672e-4f16-8ef7-0fe73b75f2c5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:52.788075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e46a9f9b-672e-4f16-8ef7-0fe73b75f2c5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:52.799675 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e46a9f9b-672e-4f16-8ef7-0fe73b75f2c5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:52.800654 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e46a9f9b-672e-4f16-8ef7-0fe73b75f2c5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:52.801454 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e46a9f9b-672e-4f16-8ef7-0fe73b75f2c5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:52.801873 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e46a9f9b-672e-4f16-8ef7-0fe73b75f2c5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:52.894020 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0a903577-1a35-4438-a88f-809a26320b6e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.323265 Jun 22 10:22:52.904411 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 263/534] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:22:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:22:52.912859 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9def4bc8-a105-4fe8-9db6-6e0149eb9f81 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:52.913909 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9def4bc8-a105-4fe8-9db6-6e0149eb9f81 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:53.053333 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9def4bc8-a105-4fe8-9db6-6e0149eb9f81 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:53.095453 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9def4bc8-a105-4fe8-9db6-6e0149eb9f81 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1094 microversion: 2.1 time: 0.186984 Jun 22 10:22:53.096053 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 264/535] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:52 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1094 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:53.106904 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e46a9f9b-672e-4f16-8ef7-0fe73b75f2c5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:53.114333 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e46a9f9b-672e-4f16-8ef7-0fe73b75f2c5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:53.115832 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e46a9f9b-672e-4f16-8ef7-0fe73b75f2c5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:53.117019 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e46a9f9b-672e-4f16-8ef7-0fe73b75f2c5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.339202 Jun 22 10:22:53.117574 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 272/536] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:52 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:53.788871 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3764e220-08fa-4e27-89a5-7ebdc4e7cd57 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:53.790139 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3764e220-08fa-4e27-89a5-7ebdc4e7cd57 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:53.798672 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3764e220-08fa-4e27-89a5-7ebdc4e7cd57 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:53.799138 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3764e220-08fa-4e27-89a5-7ebdc4e7cd57 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:53.799922 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3764e220-08fa-4e27-89a5-7ebdc4e7cd57 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:53.814433 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3764e220-08fa-4e27-89a5-7ebdc4e7cd57 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:54.120100 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6a88f585-ff25-4876-b18b-a8c195212da7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:54.143856 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6a88f585-ff25-4876-b18b-a8c195212da7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:54.168917 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3764e220-08fa-4e27-89a5-7ebdc4e7cd57 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:54.183118 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3764e220-08fa-4e27-89a5-7ebdc4e7cd57 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1699 microversion: 2.1 time: 0.398330 Jun 22 10:22:54.196892 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 273/537] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:53 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1699 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:54.202169 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f5256f07-cf4f-4982-939f-2ce0323d7e21 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:54.203082 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f5256f07-cf4f-4982-939f-2ce0323d7e21 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:54.212077 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f5256f07-cf4f-4982-939f-2ce0323d7e21 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:54.212967 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f5256f07-cf4f-4982-939f-2ce0323d7e21 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:54.214011 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f5256f07-cf4f-4982-939f-2ce0323d7e21 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:54.214702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f5256f07-cf4f-4982-939f-2ce0323d7e21 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:54.322776 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6a88f585-ff25-4876-b18b-a8c195212da7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:54.334843 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6a88f585-ff25-4876-b18b-a8c195212da7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1094 microversion: 2.1 time: 0.221522 Jun 22 10:22:54.343567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 265/538] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:54 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1094 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:54.361148 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c5703722-17fe-4224-9da1-94c4b78879d3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:54.382706 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5703722-17fe-4224-9da1-94c4b78879d3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:54.385718 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5703722-17fe-4224-9da1-94c4b78879d3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:54.440227 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c5703722-17fe-4224-9da1-94c4b78879d3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Going to try to start instance {{(pid=118327) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 10:22:54.592382 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f5256f07-cf4f-4982-939f-2ce0323d7e21 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:54.596704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f5256f07-cf4f-4982-939f-2ce0323d7e21 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:54.602475 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f5256f07-cf4f-4982-939f-2ce0323d7e21 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:54.606133 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f5256f07-cf4f-4982-939f-2ce0323d7e21 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.407308 Jun 22 10:22:54.607027 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 274/539] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:54 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:54.981206 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c5703722-17fe-4224-9da1-94c4b78879d3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "POST /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/action" status: 202 len: 0 microversion: 2.1 time: 0.635722 Jun 22 10:22:54.986072 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 266/540] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:22:54 2022] POST /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:22:54.991849 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7a1195cb-8125-4c00-a68d-7243ffb1badb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:54.993115 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7a1195cb-8125-4c00-a68d-7243ffb1badb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:55.000011 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7a1195cb-8125-4c00-a68d-7243ffb1badb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.012736 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7a1195cb-8125-4c00-a68d-7243ffb1badb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:55.013799 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7a1195cb-8125-4c00-a68d-7243ffb1badb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.014256 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7a1195cb-8125-4c00-a68d-7243ffb1badb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:55.361749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1a14dd92-e36d-484c-a60f-a1743121c415 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:55.364082 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1a14dd92-e36d-484c-a60f-a1743121c415 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:55.383713 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1a14dd92-e36d-484c-a60f-a1743121c415 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.392140 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1a14dd92-e36d-484c-a60f-a1743121c415 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:55.392140 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1a14dd92-e36d-484c-a60f-a1743121c415 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.392140 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1a14dd92-e36d-484c-a60f-a1743121c415 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:55.566323 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1a14dd92-e36d-484c-a60f-a1743121c415 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:55.584340 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7a1195cb-8125-4c00-a68d-7243ffb1badb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:55.588925 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1a14dd92-e36d-484c-a60f-a1743121c415 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1144 microversion: 2.1 time: 0.225893 Jun 22 10:22:55.602365 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 267/541] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:55 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1144 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:55.604465 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7a1195cb-8125-4c00-a68d-7243ffb1badb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1708 microversion: 2.1 time: 0.617553 Jun 22 10:22:55.606982 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 275/542] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:54 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1708 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:55.632618 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7923b173-5f57-4fdd-b021-50f1a84d5e04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:55.633373 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7923b173-5f57-4fdd-b021-50f1a84d5e04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:55.652681 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7923b173-5f57-4fdd-b021-50f1a84d5e04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.653341 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7923b173-5f57-4fdd-b021-50f1a84d5e04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:55.655811 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7923b173-5f57-4fdd-b021-50f1a84d5e04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.656350 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7923b173-5f57-4fdd-b021-50f1a84d5e04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:56.039948 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7923b173-5f57-4fdd-b021-50f1a84d5e04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:56.055939 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7923b173-5f57-4fdd-b021-50f1a84d5e04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:56.073305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7923b173-5f57-4fdd-b021-50f1a84d5e04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:56.087003 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7923b173-5f57-4fdd-b021-50f1a84d5e04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.457099 Jun 22 10:22:56.100000 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 268/543] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:55 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:56.609548 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7ccfe162-8ef6-4a5d-9090-7626cf917850 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:56.610794 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7ccfe162-8ef6-4a5d-9090-7626cf917850 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:56.622231 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7ccfe162-8ef6-4a5d-9090-7626cf917850 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:56.622943 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7ccfe162-8ef6-4a5d-9090-7626cf917850 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:56.623112 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f34b34a8-4e1f-425c-9d16-0a3f1db023ab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:56.623902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f34b34a8-4e1f-425c-9d16-0a3f1db023ab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:56.624544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7ccfe162-8ef6-4a5d-9090-7626cf917850 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:56.625268 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7ccfe162-8ef6-4a5d-9090-7626cf917850 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:56.640969 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f34b34a8-4e1f-425c-9d16-0a3f1db023ab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:56.641387 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f34b34a8-4e1f-425c-9d16-0a3f1db023ab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:56.642546 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f34b34a8-4e1f-425c-9d16-0a3f1db023ab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:56.644494 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f34b34a8-4e1f-425c-9d16-0a3f1db023ab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:56.779988 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7ccfe162-8ef6-4a5d-9090-7626cf917850 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:56.794734 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7ccfe162-8ef6-4a5d-9090-7626cf917850 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1192 microversion: 2.1 time: 0.189416 Jun 22 10:22:56.801481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 276/544] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:56 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1192 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:57.055770 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f34b34a8-4e1f-425c-9d16-0a3f1db023ab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:57.066090 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f34b34a8-4e1f-425c-9d16-0a3f1db023ab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1708 microversion: 2.1 time: 0.447003 Jun 22 10:22:57.067139 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 269/545] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:56 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1708 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:57.108678 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f6bae520-15ac-4ff5-bd12-b4af8984d4af tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:57.109237 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f6bae520-15ac-4ff5-bd12-b4af8984d4af tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:57.115673 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f6bae520-15ac-4ff5-bd12-b4af8984d4af tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:57.116129 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f6bae520-15ac-4ff5-bd12-b4af8984d4af tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:57.116932 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f6bae520-15ac-4ff5-bd12-b4af8984d4af tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:57.117362 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f6bae520-15ac-4ff5-bd12-b4af8984d4af tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:57.299935 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f6bae520-15ac-4ff5-bd12-b4af8984d4af tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:57.309581 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f6bae520-15ac-4ff5-bd12-b4af8984d4af tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:57.311229 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f6bae520-15ac-4ff5-bd12-b4af8984d4af tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:57.312511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f6bae520-15ac-4ff5-bd12-b4af8984d4af tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.210969 Jun 22 10:22:57.313186 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 277/546] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:57 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:57.822139 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b13d9b3c-0fd9-4d58-9f98-4ccdf34fc64a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:57.823507 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b13d9b3c-0fd9-4d58-9f98-4ccdf34fc64a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:57.831117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b13d9b3c-0fd9-4d58-9f98-4ccdf34fc64a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:57.831869 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b13d9b3c-0fd9-4d58-9f98-4ccdf34fc64a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:57.832666 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b13d9b3c-0fd9-4d58-9f98-4ccdf34fc64a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:57.833138 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b13d9b3c-0fd9-4d58-9f98-4ccdf34fc64a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:57.907874 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b13d9b3c-0fd9-4d58-9f98-4ccdf34fc64a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:57.914371 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b13d9b3c-0fd9-4d58-9f98-4ccdf34fc64a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1200 microversion: 2.1 time: 0.098893 Jun 22 10:22:57.924180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 270/547] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:57 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1200 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:58.083393 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3ea25f96-fb62-4478-b682-61722b4803fe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:58.084190 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3ea25f96-fb62-4478-b682-61722b4803fe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:58.090759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3ea25f96-fb62-4478-b682-61722b4803fe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:58.094085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3ea25f96-fb62-4478-b682-61722b4803fe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:58.094085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3ea25f96-fb62-4478-b682-61722b4803fe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:58.094085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3ea25f96-fb62-4478-b682-61722b4803fe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:58.271277 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3ea25f96-fb62-4478-b682-61722b4803fe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:58.275943 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3ea25f96-fb62-4478-b682-61722b4803fe tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1708 microversion: 2.1 time: 0.196818 Jun 22 10:22:58.288057 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 278/548] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:58 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1708 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:58.333867 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a4449ff3-24c6-4a21-9f5b-3ba8faf2ac54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:58.334528 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a4449ff3-24c6-4a21-9f5b-3ba8faf2ac54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:58.348790 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4449ff3-24c6-4a21-9f5b-3ba8faf2ac54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:58.349273 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4449ff3-24c6-4a21-9f5b-3ba8faf2ac54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:58.350415 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4449ff3-24c6-4a21-9f5b-3ba8faf2ac54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:58.350859 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4449ff3-24c6-4a21-9f5b-3ba8faf2ac54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:58.647025 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a4449ff3-24c6-4a21-9f5b-3ba8faf2ac54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:58.663880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a4449ff3-24c6-4a21-9f5b-3ba8faf2ac54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:58.666199 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a4449ff3-24c6-4a21-9f5b-3ba8faf2ac54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:58.668008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a4449ff3-24c6-4a21-9f5b-3ba8faf2ac54 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.339851 Jun 22 10:22:58.669594 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 271/549] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:58 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:58.931401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e8be2721-4c84-4c74-af81-bc4019789113 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:58.934402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e8be2721-4c84-4c74-af81-bc4019789113 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:58.942348 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e8be2721-4c84-4c74-af81-bc4019789113 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:58.943215 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e8be2721-4c84-4c74-af81-bc4019789113 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:58.944246 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e8be2721-4c84-4c74-af81-bc4019789113 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:58.944994 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e8be2721-4c84-4c74-af81-bc4019789113 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:59.238437 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e8be2721-4c84-4c74-af81-bc4019789113 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:59.247296 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e8be2721-4c84-4c74-af81-bc4019789113 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1278 microversion: 2.1 time: 0.321504 Jun 22 10:22:59.254913 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 279/550] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:58 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1278 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:59.294370 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7163edc4-9003-4ba7-9fc7-dae1ecfa7409 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:59.295639 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7163edc4-9003-4ba7-9fc7-dae1ecfa7409 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:59.306853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7163edc4-9003-4ba7-9fc7-dae1ecfa7409 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:59.307317 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7163edc4-9003-4ba7-9fc7-dae1ecfa7409 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:59.308170 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7163edc4-9003-4ba7-9fc7-dae1ecfa7409 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:59.317621 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7163edc4-9003-4ba7-9fc7-dae1ecfa7409 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:59.354418 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:59.634409 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7163edc4-9003-4ba7-9fc7-dae1ecfa7409 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:59.644256 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7163edc4-9003-4ba7-9fc7-dae1ecfa7409 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1712 microversion: 2.1 time: 0.353657 Jun 22 10:22:59.654127 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 272/551] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:59 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1712 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:59.687289 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ee8805ac-28f2-47c3-84e3-99613d6748d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:59.690490 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ee8805ac-28f2-47c3-84e3-99613d6748d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:59.698913 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ee8805ac-28f2-47c3-84e3-99613d6748d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:59.705185 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ee8805ac-28f2-47c3-84e3-99613d6748d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:59.705185 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ee8805ac-28f2-47c3-84e3-99613d6748d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:59.705185 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ee8805ac-28f2-47c3-84e3-99613d6748d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:59.747069 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:59.938319 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ee8805ac-28f2-47c3-84e3-99613d6748d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:59.949055 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ee8805ac-28f2-47c3-84e3-99613d6748d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:59.950560 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ee8805ac-28f2-47c3-84e3-99613d6748d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:59.958678 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ee8805ac-28f2-47c3-84e3-99613d6748d1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.275734 Jun 22 10:22:59.963275 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 280/552] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:59 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:00.273271 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7f213462-8a5a-4956-88a8-f66a3a29c635 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:00.274091 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7f213462-8a5a-4956-88a8-f66a3a29c635 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:00.284902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7f213462-8a5a-4956-88a8-f66a3a29c635 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:00.287156 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7f213462-8a5a-4956-88a8-f66a3a29c635 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:00.288812 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7f213462-8a5a-4956-88a8-f66a3a29c635 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:00.292315 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7f213462-8a5a-4956-88a8-f66a3a29c635 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:00.623795 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7f213462-8a5a-4956-88a8-f66a3a29c635 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:00.671125 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7f213462-8a5a-4956-88a8-f66a3a29c635 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.403700 Jun 22 10:23:00.689858 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 273/553] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:00 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:00.783123 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-2c7780f5-934f-45d5-a6dd-32514d568849 req-575dedf7-737b-4314-b13e-10d80905d9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da7b015-3aba-44c4-bcc3-3f90cb093d11", "tag": "fd686c54-9ac5-4c30-b37a-16a0f75b9906"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:00.810533 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-2c7780f5-934f-45d5-a6dd-32514d568849 req-575dedf7-737b-4314-b13e-10d80905d9f5 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:00.810978 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-2c7780f5-934f-45d5-a6dd-32514d568849 req-575dedf7-737b-4314-b13e-10d80905d9f5 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:00.838369 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-2c7780f5-934f-45d5-a6dd-32514d568849 req-575dedf7-737b-4314-b13e-10d80905d9f5 service nova] Creating event network-changed:fd686c54-9ac5-4c30-b37a-16a0f75b9906 for instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 on hv-cinder-84327 Jun 22 10:23:00.856446 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-2c7780f5-934f-45d5-a6dd-32514d568849 req-575dedf7-737b-4314-b13e-10d80905d9f5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077716 Jun 22 10:23:00.867677 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 281/554] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:00.980508 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-41a4fc44-7c90-4433-990f-b51e69700fa1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:00.981423 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-41a4fc44-7c90-4433-990f-b51e69700fa1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:00.995826 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-41a4fc44-7c90-4433-990f-b51e69700fa1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:01.001543 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-41a4fc44-7c90-4433-990f-b51e69700fa1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:01.002724 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-41a4fc44-7c90-4433-990f-b51e69700fa1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:01.003342 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-41a4fc44-7c90-4433-990f-b51e69700fa1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:01.215993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-41a4fc44-7c90-4433-990f-b51e69700fa1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:01.230826 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-41a4fc44-7c90-4433-990f-b51e69700fa1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:01.232901 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-41a4fc44-7c90-4433-990f-b51e69700fa1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:01.234290 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-41a4fc44-7c90-4433-990f-b51e69700fa1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.257667 Jun 22 10:23:01.235364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 274/555] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:00 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:01.697382 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2ddc1606-eb99-4d9b-8559-e86a1c1099b6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:01.698443 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2ddc1606-eb99-4d9b-8559-e86a1c1099b6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:01.717596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2ddc1606-eb99-4d9b-8559-e86a1c1099b6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:01.718000 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2ddc1606-eb99-4d9b-8559-e86a1c1099b6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:01.718858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2ddc1606-eb99-4d9b-8559-e86a1c1099b6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:01.719445 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2ddc1606-eb99-4d9b-8559-e86a1c1099b6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:02.040084 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2ddc1606-eb99-4d9b-8559-e86a1c1099b6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:02.070705 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2ddc1606-eb99-4d9b-8559-e86a1c1099b6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.378648 Jun 22 10:23:02.083011 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 282/556] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:01 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:02.253422 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2c25cfb6-dfd3-4eab-81c6-c919b50bdf70 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:02.258153 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2c25cfb6-dfd3-4eab-81c6-c919b50bdf70 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:02.258153 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:02.262075 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2c25cfb6-dfd3-4eab-81c6-c919b50bdf70 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:02.262526 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2c25cfb6-dfd3-4eab-81c6-c919b50bdf70 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:02.263300 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2c25cfb6-dfd3-4eab-81c6-c919b50bdf70 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:02.263737 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2c25cfb6-dfd3-4eab-81c6-c919b50bdf70 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:02.401792 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2c25cfb6-dfd3-4eab-81c6-c919b50bdf70 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:02.410592 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2c25cfb6-dfd3-4eab-81c6-c919b50bdf70 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:02.441377 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2c25cfb6-dfd3-4eab-81c6-c919b50bdf70 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:02.441377 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2c25cfb6-dfd3-4eab-81c6-c919b50bdf70 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.164111 Jun 22 10:23:02.441377 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 275/557] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:02 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:03.088755 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5b929b0c-61c2-4350-9ef0-39cf196a4a5c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:03.089847 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5b929b0c-61c2-4350-9ef0-39cf196a4a5c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:03.095973 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5b929b0c-61c2-4350-9ef0-39cf196a4a5c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:03.096474 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5b929b0c-61c2-4350-9ef0-39cf196a4a5c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:03.097350 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5b929b0c-61c2-4350-9ef0-39cf196a4a5c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:03.098411 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5b929b0c-61c2-4350-9ef0-39cf196a4a5c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:03.432557 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-528cfe58-367a-4caa-8558-108d1a55321f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:03.433325 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-528cfe58-367a-4caa-8558-108d1a55321f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:03.440460 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-528cfe58-367a-4caa-8558-108d1a55321f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:03.441136 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-528cfe58-367a-4caa-8558-108d1a55321f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:03.441910 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-528cfe58-367a-4caa-8558-108d1a55321f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:03.442350 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-528cfe58-367a-4caa-8558-108d1a55321f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:03.471774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5b929b0c-61c2-4350-9ef0-39cf196a4a5c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:03.480060 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5b929b0c-61c2-4350-9ef0-39cf196a4a5c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.395688 Jun 22 10:23:03.480639 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 283/558] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:03 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:03.575274 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-528cfe58-367a-4caa-8558-108d1a55321f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:03.583238 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-528cfe58-367a-4caa-8558-108d1a55321f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:03.584732 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-528cfe58-367a-4caa-8558-108d1a55321f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:03.586192 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-528cfe58-367a-4caa-8558-108d1a55321f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.157910 Jun 22 10:23:03.586739 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 276/559] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:03 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:23:04.500983 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a38fa273-b824-4834-b970-3d9706b2424c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:04.503189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a38fa273-b824-4834-b970-3d9706b2424c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:04.542714 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a38fa273-b824-4834-b970-3d9706b2424c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:04.543996 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a38fa273-b824-4834-b970-3d9706b2424c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:04.547016 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a38fa273-b824-4834-b970-3d9706b2424c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:04.549292 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a38fa273-b824-4834-b970-3d9706b2424c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:04.603453 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-01672a06-fcb9-4b28-92bf-e58cd0955226 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:04.604145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-01672a06-fcb9-4b28-92bf-e58cd0955226 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:04.606393 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=10 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:04.619156 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-01672a06-fcb9-4b28-92bf-e58cd0955226 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:04.621493 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-01672a06-fcb9-4b28-92bf-e58cd0955226 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:04.622612 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-01672a06-fcb9-4b28-92bf-e58cd0955226 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:04.626218 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-01672a06-fcb9-4b28-92bf-e58cd0955226 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:04.877993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-01672a06-fcb9-4b28-92bf-e58cd0955226 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:04.887548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-01672a06-fcb9-4b28-92bf-e58cd0955226 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:04.888772 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a38fa273-b824-4834-b970-3d9706b2424c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:04.898332 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-01672a06-fcb9-4b28-92bf-e58cd0955226 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:04.925493 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-01672a06-fcb9-4b28-92bf-e58cd0955226 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.300168 Jun 22 10:23:04.925727 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a38fa273-b824-4834-b970-3d9706b2424c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.405937 Jun 22 10:23:04.925727 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 284/560] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:04 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:04.925935 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 277/561] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:04 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:23:05.917547 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-45bfe5af-fc7b-475f-af0a-f55638f49532 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:05.918299 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-45bfe5af-fc7b-475f-af0a-f55638f49532 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:05.918529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-287536dd-2f91-4cb8-b4f4-ddadcf08898b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:05.919144 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-287536dd-2f91-4cb8-b4f4-ddadcf08898b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:05.930774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-45bfe5af-fc7b-475f-af0a-f55638f49532 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:05.931156 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-45bfe5af-fc7b-475f-af0a-f55638f49532 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:05.931957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-45bfe5af-fc7b-475f-af0a-f55638f49532 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:05.932404 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-45bfe5af-fc7b-475f-af0a-f55638f49532 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:05.939003 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-287536dd-2f91-4cb8-b4f4-ddadcf08898b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:05.939475 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-287536dd-2f91-4cb8-b4f4-ddadcf08898b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:05.940311 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-287536dd-2f91-4cb8-b4f4-ddadcf08898b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:05.940807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-287536dd-2f91-4cb8-b4f4-ddadcf08898b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:06.161233 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-45bfe5af-fc7b-475f-af0a-f55638f49532 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:06.172799 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-45bfe5af-fc7b-475f-af0a-f55638f49532 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.258839 Jun 22 10:23:06.175812 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 285/562] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:05 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:06.262602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-287536dd-2f91-4cb8-b4f4-ddadcf08898b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:06.278952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-287536dd-2f91-4cb8-b4f4-ddadcf08898b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:06.281008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-287536dd-2f91-4cb8-b4f4-ddadcf08898b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:06.282230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-287536dd-2f91-4cb8-b4f4-ddadcf08898b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.368134 Jun 22 10:23:06.283385 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 278/563] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:05 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:07.190440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-535a604d-e371-4e77-aea9-da1e22329f75 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:07.191095 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-535a604d-e371-4e77-aea9-da1e22329f75 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:07.198542 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-535a604d-e371-4e77-aea9-da1e22329f75 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:07.199009 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-535a604d-e371-4e77-aea9-da1e22329f75 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:07.199855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-535a604d-e371-4e77-aea9-da1e22329f75 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:07.200333 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-535a604d-e371-4e77-aea9-da1e22329f75 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:07.302167 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cf314ef2-7c6e-467c-b0f5-78234377554b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:07.302871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-cf314ef2-7c6e-467c-b0f5-78234377554b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:07.309457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cf314ef2-7c6e-467c-b0f5-78234377554b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:07.309984 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cf314ef2-7c6e-467c-b0f5-78234377554b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:07.310821 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cf314ef2-7c6e-467c-b0f5-78234377554b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:07.311326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cf314ef2-7c6e-467c-b0f5-78234377554b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:07.337405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-535a604d-e371-4e77-aea9-da1e22329f75 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:07.344993 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-535a604d-e371-4e77-aea9-da1e22329f75 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.158450 Jun 22 10:23:07.345568 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 286/564] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:07 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:07.448777 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cf314ef2-7c6e-467c-b0f5-78234377554b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:07.456637 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cf314ef2-7c6e-467c-b0f5-78234377554b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:07.458209 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cf314ef2-7c6e-467c-b0f5-78234377554b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:07.459344 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cf314ef2-7c6e-467c-b0f5-78234377554b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.161641 Jun 22 10:23:07.459893 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 279/565] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:07 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:23:08.362130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-765cc2dc-1ffc-4b91-8d05-4d691257ae92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:08.362834 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-765cc2dc-1ffc-4b91-8d05-4d691257ae92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:08.369408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-765cc2dc-1ffc-4b91-8d05-4d691257ae92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:08.369863 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-765cc2dc-1ffc-4b91-8d05-4d691257ae92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:08.370632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-765cc2dc-1ffc-4b91-8d05-4d691257ae92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:08.373171 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-765cc2dc-1ffc-4b91-8d05-4d691257ae92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:08.480416 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-694fa8e1-6065-4f8b-b02c-3f42818e7293 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:08.481096 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-694fa8e1-6065-4f8b-b02c-3f42818e7293 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:08.487683 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-694fa8e1-6065-4f8b-b02c-3f42818e7293 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:08.488137 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-694fa8e1-6065-4f8b-b02c-3f42818e7293 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:08.489683 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-694fa8e1-6065-4f8b-b02c-3f42818e7293 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:08.490474 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-694fa8e1-6065-4f8b-b02c-3f42818e7293 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:08.507251 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-765cc2dc-1ffc-4b91-8d05-4d691257ae92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:08.515439 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-765cc2dc-1ffc-4b91-8d05-4d691257ae92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.157191 Jun 22 10:23:08.516182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 287/566] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:08 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:08.639320 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-694fa8e1-6065-4f8b-b02c-3f42818e7293 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:08.647254 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-694fa8e1-6065-4f8b-b02c-3f42818e7293 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:08.648964 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-694fa8e1-6065-4f8b-b02c-3f42818e7293 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:08.650136 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-694fa8e1-6065-4f8b-b02c-3f42818e7293 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.177579 Jun 22 10:23:08.650706 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 280/567] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:08 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:09.532324 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6c5df01d-e224-472f-a776-4b48d63f4389 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:09.533192 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6c5df01d-e224-472f-a776-4b48d63f4389 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:09.555556 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6c5df01d-e224-472f-a776-4b48d63f4389 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:09.556022 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6c5df01d-e224-472f-a776-4b48d63f4389 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:09.556807 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6c5df01d-e224-472f-a776-4b48d63f4389 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:09.557345 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6c5df01d-e224-472f-a776-4b48d63f4389 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:09.705859 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f34cd8e0-2510-4a3d-86d2-e507a5272dd3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:09.705859 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f34cd8e0-2510-4a3d-86d2-e507a5272dd3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:09.705859 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f34cd8e0-2510-4a3d-86d2-e507a5272dd3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:09.705859 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f34cd8e0-2510-4a3d-86d2-e507a5272dd3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:09.707067 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f34cd8e0-2510-4a3d-86d2-e507a5272dd3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:09.707067 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f34cd8e0-2510-4a3d-86d2-e507a5272dd3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:09.714078 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6c5df01d-e224-472f-a776-4b48d63f4389 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:09.722452 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6c5df01d-e224-472f-a776-4b48d63f4389 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.194630 Jun 22 10:23:09.723403 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 288/568] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:09 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:09.860410 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f34cd8e0-2510-4a3d-86d2-e507a5272dd3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:09.870952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f34cd8e0-2510-4a3d-86d2-e507a5272dd3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:09.873426 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f34cd8e0-2510-4a3d-86d2-e507a5272dd3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:09.875344 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f34cd8e0-2510-4a3d-86d2-e507a5272dd3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.209801 Jun 22 10:23:09.887482 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 281/569] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:09 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:10.468442 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3c5e478b-ca5c-4507-ab2f-62f56ba18943 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Action: 'create', calling method: .version_select at 0x7f021fdd6dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-456424453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYZF3EFIqF3Vq1nViVUaRFdUA5yEe5FHUoibprKly33TZ15Fx5ncLxVFF15k+6XApOrGVkrV97nqidRhDRQA6lPhdK97FoMVbO/bEGaU5na8LwAv/k4NBuhkP2RtwVDWQ=="}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:10.482510 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-3c5e478b-ca5c-4507-ab2f-62f56ba18943 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Getting quotas for project 9dfa249b41a8422fae46988649977e6e. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:23:10.486243 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-3c5e478b-ca5c-4507-ab2f-62f56ba18943 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Getting quotas for user f778bbdc67024183aca4711b9d87105e and project 9dfa249b41a8422fae46988649977e6e. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:23:10.739966 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b3ce37b6-aa4f-4980-9c30-664cd5171506 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:10.740589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b3ce37b6-aa4f-4980-9c30-664cd5171506 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:10.747456 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b3ce37b6-aa4f-4980-9c30-664cd5171506 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:10.747912 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b3ce37b6-aa4f-4980-9c30-664cd5171506 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:10.748708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b3ce37b6-aa4f-4980-9c30-664cd5171506 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:10.749175 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b3ce37b6-aa4f-4980-9c30-664cd5171506 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:10.766341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3c5e478b-ca5c-4507-ab2f-62f56ba18943 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.301755 Jun 22 10:23:10.767701 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 289/570] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jun 22 10:23:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:10.824316 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1215051332", "imageRef": "381f968d-0ec8-433e-adad-20e0e2c40361", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-456424453", "networks": [{"uuid": "6a16e62f-e138-4b26-a6b5-bc93972f5e31"}]}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:10.896724 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.network.neutron [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] validate_networks() for [('6a16e62f-e138-4b26-a6b5-bc93972f5e31', None, None, None, None, None)] {{(pid=118326) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:23:10.901632 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b3ce37b6-aa4f-4980-9c30-664cd5171506 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:10.910069 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b3ce37b6-aa4f-4980-9c30-664cd5171506 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.174667 Jun 22 10:23:10.911817 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 282/571] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:10 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:10.916621 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fd6fcfef-2ba5-4a29-93f1-678fd26c7eed tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:10.917381 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-fd6fcfef-2ba5-4a29-93f1-678fd26c7eed tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:10.923419 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fd6fcfef-2ba5-4a29-93f1-678fd26c7eed tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:10.924020 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fd6fcfef-2ba5-4a29-93f1-678fd26c7eed tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:10.924884 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fd6fcfef-2ba5-4a29-93f1-678fd26c7eed tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:10.925385 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fd6fcfef-2ba5-4a29-93f1-678fd26c7eed tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:11.140676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-fd6fcfef-2ba5-4a29-93f1-678fd26c7eed tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:11.149650 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-fd6fcfef-2ba5-4a29-93f1-678fd26c7eed tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:11.151188 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-fd6fcfef-2ba5-4a29-93f1-678fd26c7eed tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:11.152369 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-fd6fcfef-2ba5-4a29-93f1-678fd26c7eed tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1741 microversion: 2.20 time: 0.239469 Jun 22 10:23:11.152958 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 283/572] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:10 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1741 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:11.347629 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Flavor limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:23:11.348059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Image limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:23:11.348564 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Flavor pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:23:11.349036 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Image pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:23:11.349453 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:23:11.358602 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:11.359052 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:11.359850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:11.360287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:11.379858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Getting quotas for project 9dfa249b41a8422fae46988649977e6e. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:23:11.383872 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Getting quotas for user f778bbdc67024183aca4711b9d87105e and project 9dfa249b41a8422fae46988649977e6e. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:23:11.395650 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Going to run 1 instances... {{(pid=118326) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:23:11.397928 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='381f968d-0ec8-433e-adad-20e0e2c40361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118326) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:23:11.582015 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9fd0582c-a413-49d9-a32d-f582089656d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762027 Jun 22 10:23:11.582657 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 290/573] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:23:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 10:23:11.592284 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-dcc6bb89-da8a-4e18-a650-2f75cfce02d5 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:11.593022 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-dcc6bb89-da8a-4e18-a650-2f75cfce02d5 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:11.651919 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-dcc6bb89-da8a-4e18-a650-2f75cfce02d5 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:11.662033 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-dcc6bb89-da8a-4e18-a650-2f75cfce02d5 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1258 microversion: 2.1 time: 0.073507 Jun 22 10:23:11.663462 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 284/574] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:11 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:11.928394 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-48533b8b-4303-4934-aa4b-34bc1400051c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:11.929137 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-48533b8b-4303-4934-aa4b-34bc1400051c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:11.935634 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-48533b8b-4303-4934-aa4b-34bc1400051c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:11.936091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-48533b8b-4303-4934-aa4b-34bc1400051c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:11.936890 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-48533b8b-4303-4934-aa4b-34bc1400051c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:11.937332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-48533b8b-4303-4934-aa4b-34bc1400051c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:12.080899 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-48533b8b-4303-4934-aa4b-34bc1400051c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:12.089530 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-48533b8b-4303-4934-aa4b-34bc1400051c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.165716 Jun 22 10:23:12.090129 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 291/575] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:11 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:12.170363 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-98b31028-a860-4841-b02d-87825d9d4383 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:12.170966 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-98b31028-a860-4841-b02d-87825d9d4383 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:12.178094 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-98b31028-a860-4841-b02d-87825d9d4383 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:12.178538 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-98b31028-a860-4841-b02d-87825d9d4383 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:12.179290 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-98b31028-a860-4841-b02d-87825d9d4383 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:12.179718 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-98b31028-a860-4841-b02d-87825d9d4383 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:12.321234 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-98b31028-a860-4841-b02d-87825d9d4383 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:12.328083 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-98b31028-a860-4841-b02d-87825d9d4383 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:12.329636 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-98b31028-a860-4841-b02d-87825d9d4383 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:12.330837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-98b31028-a860-4841-b02d-87825d9d4383 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1723 microversion: 2.20 time: 0.164358 Jun 22 10:23:12.331391 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 285/576] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:12 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:12.682203 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b264e538-cdcb-455a-a797-99933ad24792 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:12.682203 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b264e538-cdcb-455a-a797-99933ad24792 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:12.735308 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b264e538-cdcb-455a-a797-99933ad24792 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:12.742159 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b264e538-cdcb-455a-a797-99933ad24792 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1258 microversion: 2.1 time: 0.066483 Jun 22 10:23:12.752427 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 292/577] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:12 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:13.107946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2c1e5099-f6dd-40b3-953f-9169b4a3e4bc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:13.108562 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2c1e5099-f6dd-40b3-953f-9169b4a3e4bc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:13.115517 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2c1e5099-f6dd-40b3-953f-9169b4a3e4bc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.115975 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2c1e5099-f6dd-40b3-953f-9169b4a3e4bc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:13.116754 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2c1e5099-f6dd-40b3-953f-9169b4a3e4bc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.117244 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2c1e5099-f6dd-40b3-953f-9169b4a3e4bc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:13.172837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-5459fe9b-c918-48a4-b352-404000f69758 req-d15515e5-9725-4924-90f2-6e06ff02181b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da7b015-3aba-44c4-bcc3-3f90cb093d11", "name": "network-vif-plugged", "status": "completed", "tag": "fd686c54-9ac5-4c30-b37a-16a0f75b9906"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:13.181486 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-5459fe9b-c918-48a4-b352-404000f69758 req-d15515e5-9725-4924-90f2-6e06ff02181b service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.181913 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-5459fe9b-c918-48a4-b352-404000f69758 req-d15515e5-9725-4924-90f2-6e06ff02181b service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:13.193711 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-5459fe9b-c918-48a4-b352-404000f69758 req-d15515e5-9725-4924-90f2-6e06ff02181b service nova] Creating event network-vif-plugged:fd686c54-9ac5-4c30-b37a-16a0f75b9906 for instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 on hv-cinder-84327 Jun 22 10:23:13.198829 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-5459fe9b-c918-48a4-b352-404000f69758 req-d15515e5-9725-4924-90f2-6e06ff02181b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029610 Jun 22 10:23:13.199425 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 293/578] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:23:13.252743 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2c1e5099-f6dd-40b3-953f-9169b4a3e4bc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:13.260806 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2c1e5099-f6dd-40b3-953f-9169b4a3e4bc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.157037 Jun 22 10:23:13.261406 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 286/579] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:13 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:13.350409 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d197f505-76bc-4c70-bc02-0b3757b08a3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:13.351166 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d197f505-76bc-4c70-bc02-0b3757b08a3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:13.357448 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d197f505-76bc-4c70-bc02-0b3757b08a3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.357900 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d197f505-76bc-4c70-bc02-0b3757b08a3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:13.358688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d197f505-76bc-4c70-bc02-0b3757b08a3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.359125 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d197f505-76bc-4c70-bc02-0b3757b08a3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:13.492445 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d197f505-76bc-4c70-bc02-0b3757b08a3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:13.500425 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d197f505-76bc-4c70-bc02-0b3757b08a3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:13.501981 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d197f505-76bc-4c70-bc02-0b3757b08a3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:13.503132 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d197f505-76bc-4c70-bc02-0b3757b08a3f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1723 microversion: 2.20 time: 0.157156 Jun 22 10:23:13.503693 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 294/580] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:13 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:13.759542 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4f8fecdb-78ef-458a-97e1-042d162b1c9f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:13.760193 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4f8fecdb-78ef-458a-97e1-042d162b1c9f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:13.766579 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f8fecdb-78ef-458a-97e1-042d162b1c9f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.767035 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f8fecdb-78ef-458a-97e1-042d162b1c9f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:13.767798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f8fecdb-78ef-458a-97e1-042d162b1c9f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.768242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4f8fecdb-78ef-458a-97e1-042d162b1c9f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:13.831024 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4f8fecdb-78ef-458a-97e1-042d162b1c9f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:13.838347 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4f8fecdb-78ef-458a-97e1-042d162b1c9f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1262 microversion: 2.1 time: 0.082684 Jun 22 10:23:13.838914 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 287/581] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:13 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:14.277351 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8368b6eb-7b4d-4c7b-a38a-5b2087418f79 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:14.277951 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8368b6eb-7b4d-4c7b-a38a-5b2087418f79 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:14.284123 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8368b6eb-7b4d-4c7b-a38a-5b2087418f79 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:14.284563 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8368b6eb-7b4d-4c7b-a38a-5b2087418f79 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:14.285410 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8368b6eb-7b4d-4c7b-a38a-5b2087418f79 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:14.285807 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8368b6eb-7b4d-4c7b-a38a-5b2087418f79 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:14.422654 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8368b6eb-7b4d-4c7b-a38a-5b2087418f79 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:14.430774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8368b6eb-7b4d-4c7b-a38a-5b2087418f79 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.157184 Jun 22 10:23:14.431346 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 295/582] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:14 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:14.521671 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-58f23837-d185-4b5b-bb5c-a9eef8d62dd2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:14.522282 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-58f23837-d185-4b5b-bb5c-a9eef8d62dd2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:14.528928 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-58f23837-d185-4b5b-bb5c-a9eef8d62dd2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:14.529384 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-58f23837-d185-4b5b-bb5c-a9eef8d62dd2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:14.530152 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-58f23837-d185-4b5b-bb5c-a9eef8d62dd2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:14.530588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-58f23837-d185-4b5b-bb5c-a9eef8d62dd2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:14.682104 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-58f23837-d185-4b5b-bb5c-a9eef8d62dd2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:14.691143 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-58f23837-d185-4b5b-bb5c-a9eef8d62dd2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:14.692707 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-58f23837-d185-4b5b-bb5c-a9eef8d62dd2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:14.694110 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-58f23837-d185-4b5b-bb5c-a9eef8d62dd2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1723 microversion: 2.20 time: 0.176393 Jun 22 10:23:14.707151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 288/583] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:14 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:14.854643 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ad69773b-01cf-4e69-a87c-395caa6fe2d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:14.855278 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ad69773b-01cf-4e69-a87c-395caa6fe2d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:14.861501 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ad69773b-01cf-4e69-a87c-395caa6fe2d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:14.861942 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ad69773b-01cf-4e69-a87c-395caa6fe2d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:14.862691 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ad69773b-01cf-4e69-a87c-395caa6fe2d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:14.863132 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ad69773b-01cf-4e69-a87c-395caa6fe2d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:14.923839 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ad69773b-01cf-4e69-a87c-395caa6fe2d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:14.932035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ad69773b-01cf-4e69-a87c-395caa6fe2d0 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1254 microversion: 2.1 time: 0.081195 Jun 22 10:23:14.932530 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 296/584] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:14 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1254 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:15.447572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-99a73b0f-85ac-4c9f-8979-b01b46fe71ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:15.448173 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-99a73b0f-85ac-4c9f-8979-b01b46fe71ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:15.454203 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-99a73b0f-85ac-4c9f-8979-b01b46fe71ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.454648 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-99a73b0f-85ac-4c9f-8979-b01b46fe71ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.455413 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-99a73b0f-85ac-4c9f-8979-b01b46fe71ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.455843 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-99a73b0f-85ac-4c9f-8979-b01b46fe71ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.589567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-99a73b0f-85ac-4c9f-8979-b01b46fe71ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:15.597278 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-99a73b0f-85ac-4c9f-8979-b01b46fe71ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.153574 Jun 22 10:23:15.597838 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 289/585] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:15 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:15.714105 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c0ba053a-f246-495a-9beb-7ee833cb3ac0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:15.714637 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c0ba053a-f246-495a-9beb-7ee833cb3ac0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:15.720712 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c0ba053a-f246-495a-9beb-7ee833cb3ac0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.721184 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c0ba053a-f246-495a-9beb-7ee833cb3ac0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.721948 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c0ba053a-f246-495a-9beb-7ee833cb3ac0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.722418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c0ba053a-f246-495a-9beb-7ee833cb3ac0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.853370 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c0ba053a-f246-495a-9beb-7ee833cb3ac0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:15.861509 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c0ba053a-f246-495a-9beb-7ee833cb3ac0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:15.863012 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c0ba053a-f246-495a-9beb-7ee833cb3ac0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:15.864167 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c0ba053a-f246-495a-9beb-7ee833cb3ac0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1726 microversion: 2.20 time: 0.154127 Jun 22 10:23:15.864718 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 297/586] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:15 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:15.881468 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a4b45f6c-c124-46ec-a040-d290620f2f6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05800d28-637f-4d80-a738-dcb7fd45da7e"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:15.882648 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a4b45f6c-c124-46ec-a040-d290620f2f6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:15.888640 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4b45f6c-c124-46ec-a040-d290620f2f6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.889116 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4b45f6c-c124-46ec-a040-d290620f2f6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.889879 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4b45f6c-c124-46ec-a040-d290620f2f6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.890314 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4b45f6c-c124-46ec-a040-d290620f2f6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.893976 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:15.948792 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-87eeed49-c62d-41cb-b835-134ea688d61f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:15.949422 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-87eeed49-c62d-41cb-b835-134ea688d61f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:15.955435 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-87eeed49-c62d-41cb-b835-134ea688d61f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.955872 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-87eeed49-c62d-41cb-b835-134ea688d61f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.956631 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-87eeed49-c62d-41cb-b835-134ea688d61f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.957087 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-87eeed49-c62d-41cb-b835-134ea688d61f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:16.019950 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-87eeed49-c62d-41cb-b835-134ea688d61f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:16.028057 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-87eeed49-c62d-41cb-b835-134ea688d61f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1310 microversion: 2.1 time: 0.083039 Jun 22 10:23:16.028658 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 298/587] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:15 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:16.614400 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-79ee5c00-54aa-4b5f-9c66-ecdafd9f46cc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:16.615095 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-79ee5c00-54aa-4b5f-9c66-ecdafd9f46cc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:16.621393 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-79ee5c00-54aa-4b5f-9c66-ecdafd9f46cc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:16.629028 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-79ee5c00-54aa-4b5f-9c66-ecdafd9f46cc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:16.629028 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-79ee5c00-54aa-4b5f-9c66-ecdafd9f46cc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:16.629028 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-79ee5c00-54aa-4b5f-9c66-ecdafd9f46cc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:16.776025 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-79ee5c00-54aa-4b5f-9c66-ecdafd9f46cc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:16.784078 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-79ee5c00-54aa-4b5f-9c66-ecdafd9f46cc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1266 microversion: 2.1 time: 0.174000 Jun 22 10:23:16.784660 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 299/588] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:16 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:17.031851 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-5c45ff77-1585-40cc-b9a5-dd35ee08356c req-b50a30f9-3080-48ac-9e18-822f62501536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fa8c96-e39d-47ce-86a0-9d7d7eaf099f", "name": "network-vif-unplugged", "status": "completed", "tag": "9c2ee9e8-f445-4686-bacb-0cbc5c3c71de"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:17.041209 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-5c45ff77-1585-40cc-b9a5-dd35ee08356c req-b50a30f9-3080-48ac-9e18-822f62501536 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.041653 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-5c45ff77-1585-40cc-b9a5-dd35ee08356c req-b50a30f9-3080-48ac-9e18-822f62501536 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.053741 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.compute.server_external_events [req-5c45ff77-1585-40cc-b9a5-dd35ee08356c req-b50a30f9-3080-48ac-9e18-822f62501536 service nova] Unable to find a host for instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f. Dropping event network-vif-unplugged {{(pid=118326) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 10:23:17.054660 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-5c45ff77-1585-40cc-b9a5-dd35ee08356c req-b50a30f9-3080-48ac-9e18-822f62501536 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026641 Jun 22 10:23:17.055227 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 300/589] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 10:23:17.060250 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a9552057-db71-46cf-a7f0-77d261c2e9b9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:17.060338 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a9552057-db71-46cf-a7f0-77d261c2e9b9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:17.066205 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a9552057-db71-46cf-a7f0-77d261c2e9b9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.066644 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a9552057-db71-46cf-a7f0-77d261c2e9b9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.067406 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a9552057-db71-46cf-a7f0-77d261c2e9b9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.067832 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a9552057-db71-46cf-a7f0-77d261c2e9b9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.130920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a9552057-db71-46cf-a7f0-77d261c2e9b9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:17.134800 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:17.140710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a9552057-db71-46cf-a7f0-77d261c2e9b9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1318 microversion: 2.1 time: 0.084432 Jun 22 10:23:17.141538 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 301/590] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:17 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1318 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:17.164414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a4b45f6c-c124-46ec-a040-d290620f2f6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "POST /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.286811 Jun 22 10:23:17.165793 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 290/591] 10.222.0.46 () {62 vars in 1363 bytes} [Wed Jun 22 10:23:15 2022] POST /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-volume_attachments => generated 188 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:23:17.294395 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-576719be-119c-4dc7-a69a-fdc05626e587 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:17.295081 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-576719be-119c-4dc7-a69a-fdc05626e587 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:17.301357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-576719be-119c-4dc7-a69a-fdc05626e587 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.309769 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-576719be-119c-4dc7-a69a-fdc05626e587 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.309769 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-576719be-119c-4dc7-a69a-fdc05626e587 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.309769 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-576719be-119c-4dc7-a69a-fdc05626e587 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.342031 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:17.649472 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-576719be-119c-4dc7-a69a-fdc05626e587 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "POST /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/action" status: 202 len: 0 microversion: 2.20 time: 0.359267 Jun 22 10:23:17.650580 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 302/592] 10.222.0.46 () {62 vars in 1318 bytes} [Wed Jun 22 10:23:17 2022] POST /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:23:17.659873 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-aaa9b47b-5c2d-4a08-8a1e-d92e4929427d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:17.666482 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-aaa9b47b-5c2d-4a08-8a1e-d92e4929427d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:17.671333 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:17.675233 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-aaa9b47b-5c2d-4a08-8a1e-d92e4929427d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.675926 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-aaa9b47b-5c2d-4a08-8a1e-d92e4929427d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.677119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-aaa9b47b-5c2d-4a08-8a1e-d92e4929427d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.677771 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-aaa9b47b-5c2d-4a08-8a1e-d92e4929427d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.804061 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-eca85e5d-2295-4c6a-812b-41073f8b3692 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:17.805291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-eca85e5d-2295-4c6a-812b-41073f8b3692 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:17.820231 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-eca85e5d-2295-4c6a-812b-41073f8b3692 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.820796 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-eca85e5d-2295-4c6a-812b-41073f8b3692 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.821709 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-eca85e5d-2295-4c6a-812b-41073f8b3692 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.822251 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-eca85e5d-2295-4c6a-812b-41073f8b3692 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.849136 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-aaa9b47b-5c2d-4a08-8a1e-d92e4929427d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:17.858389 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-aaa9b47b-5c2d-4a08-8a1e-d92e4929427d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:17.860041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-aaa9b47b-5c2d-4a08-8a1e-d92e4929427d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:17.861332 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-aaa9b47b-5c2d-4a08-8a1e-d92e4929427d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1752 microversion: 2.20 time: 0.206606 Jun 22 10:23:17.861980 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 291/593] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:17 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1752 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:17.971440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-eca85e5d-2295-4c6a-812b-41073f8b3692 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:17.977454 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-eca85e5d-2295-4c6a-812b-41073f8b3692 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1454 microversion: 2.1 time: 0.180389 Jun 22 10:23:17.978752 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 303/594] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:17 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:17.995353 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0bb0ef9c-b4cb-48c0-b3cb-ffa32fb4a5ef tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:17.995972 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0bb0ef9c-b4cb-48c0-b3cb-ffa32fb4a5ef tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:18.003959 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0bb0ef9c-b4cb-48c0-b3cb-ffa32fb4a5ef tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.005895 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0bb0ef9c-b4cb-48c0-b3cb-ffa32fb4a5ef tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:18.006763 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0bb0ef9c-b4cb-48c0-b3cb-ffa32fb4a5ef tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.007593 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0bb0ef9c-b4cb-48c0-b3cb-ffa32fb4a5ef tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:18.162723 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-476cec54-cdce-40e6-8728-b0efec9ce4e2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:18.163657 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-476cec54-cdce-40e6-8728-b0efec9ce4e2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:18.175445 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-476cec54-cdce-40e6-8728-b0efec9ce4e2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.176041 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-476cec54-cdce-40e6-8728-b0efec9ce4e2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:18.179730 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-476cec54-cdce-40e6-8728-b0efec9ce4e2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.180174 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-476cec54-cdce-40e6-8728-b0efec9ce4e2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:18.244050 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0bb0ef9c-b4cb-48c0-b3cb-ffa32fb4a5ef tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:18.265428 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0bb0ef9c-b4cb-48c0-b3cb-ffa32fb4a5ef tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1454 microversion: 2.1 time: 0.264446 Jun 22 10:23:18.265428 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 292/595] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:17 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1454 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:18.492167 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-476cec54-cdce-40e6-8728-b0efec9ce4e2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:18.509795 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-476cec54-cdce-40e6-8728-b0efec9ce4e2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.353692 Jun 22 10:23:18.512011 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 304/596] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:18 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:18.888551 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a4fc5e9b-da6a-4046-9047-232bab1ee6ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:18.889574 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a4fc5e9b-da6a-4046-9047-232bab1ee6ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:18.898606 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4fc5e9b-da6a-4046-9047-232bab1ee6ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.899351 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4fc5e9b-da6a-4046-9047-232bab1ee6ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:18.900446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4fc5e9b-da6a-4046-9047-232bab1ee6ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.901159 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4fc5e9b-da6a-4046-9047-232bab1ee6ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:19.349839 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a4fc5e9b-da6a-4046-9047-232bab1ee6ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:19.360701 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a4fc5e9b-da6a-4046-9047-232bab1ee6ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:19.367409 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a4fc5e9b-da6a-4046-9047-232bab1ee6ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:19.372347 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a4fc5e9b-da6a-4046-9047-232bab1ee6ac tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1752 microversion: 2.20 time: 0.496154 Jun 22 10:23:19.379716 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 293/597] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:18 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1752 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:19.529300 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6810a383-a6f1-401d-b6b9-fc0e35bccccf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:19.533554 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6810a383-a6f1-401d-b6b9-fc0e35bccccf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:19.538563 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6810a383-a6f1-401d-b6b9-fc0e35bccccf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:19.539019 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6810a383-a6f1-401d-b6b9-fc0e35bccccf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:19.539806 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6810a383-a6f1-401d-b6b9-fc0e35bccccf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:19.540254 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6810a383-a6f1-401d-b6b9-fc0e35bccccf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:19.825222 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6810a383-a6f1-401d-b6b9-fc0e35bccccf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:19.836375 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6810a383-a6f1-401d-b6b9-fc0e35bccccf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.310791 Jun 22 10:23:19.846739 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 305/598] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:19 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:19.906789 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-c9622e06-9fab-4b7f-8152-8f6fec9b5a15 req-6fb33bd2-7462-4759-9ed3-c2e7fa4b0103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4e73d9-0607-4ae9-8fb5-30bd61f928f1", "tag": "249b9885-08e1-4d0f-8a26-3a03a7f683a3"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:19.921050 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-c9622e06-9fab-4b7f-8152-8f6fec9b5a15 req-6fb33bd2-7462-4759-9ed3-c2e7fa4b0103 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:19.924141 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-c9622e06-9fab-4b7f-8152-8f6fec9b5a15 req-6fb33bd2-7462-4759-9ed3-c2e7fa4b0103 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:19.951740 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-c9622e06-9fab-4b7f-8152-8f6fec9b5a15 req-6fb33bd2-7462-4759-9ed3-c2e7fa4b0103 service nova] Creating event network-changed:249b9885-08e1-4d0f-8a26-3a03a7f683a3 for instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 on hv-cinder-84327 Jun 22 10:23:19.963857 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-c9622e06-9fab-4b7f-8152-8f6fec9b5a15 req-6fb33bd2-7462-4759-9ed3-c2e7fa4b0103 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059475 Jun 22 10:23:19.969889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 294/599] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:20.398537 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-be6014e4-6f5e-48c5-9ece-1065688ecb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:20.399143 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-be6014e4-6f5e-48c5-9ece-1065688ecb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:20.405887 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-be6014e4-6f5e-48c5-9ece-1065688ecb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:20.406341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-be6014e4-6f5e-48c5-9ece-1065688ecb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:20.407162 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-be6014e4-6f5e-48c5-9ece-1065688ecb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:20.407761 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-be6014e4-6f5e-48c5-9ece-1065688ecb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:20.706970 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-be6014e4-6f5e-48c5-9ece-1065688ecb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:20.716089 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-be6014e4-6f5e-48c5-9ece-1065688ecb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:20.717569 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-be6014e4-6f5e-48c5-9ece-1065688ecb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:20.718763 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-be6014e4-6f5e-48c5-9ece-1065688ecb6b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1752 microversion: 2.20 time: 0.326640 Jun 22 10:23:20.719342 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 306/600] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:20 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1752 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:20.854786 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-97e31661-f09a-4915-b11c-3f574398d128 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:20.855480 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-97e31661-f09a-4915-b11c-3f574398d128 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:20.864311 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-97e31661-f09a-4915-b11c-3f574398d128 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:20.864755 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-97e31661-f09a-4915-b11c-3f574398d128 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:20.865778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-97e31661-f09a-4915-b11c-3f574398d128 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:20.866210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-97e31661-f09a-4915-b11c-3f574398d128 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:21.115726 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-97e31661-f09a-4915-b11c-3f574398d128 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:21.126067 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-97e31661-f09a-4915-b11c-3f574398d128 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.275284 Jun 22 10:23:21.126671 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 295/601] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:20 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:21.538729 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-95ed31bf-7b56-4b9a-be2b-5c138973b84e req-03d5bc6e-7ad9-4d42-a602-1472168dc221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da7b015-3aba-44c4-bcc3-3f90cb093d11", "tag": "fd686c54-9ac5-4c30-b37a-16a0f75b9906"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:21.545872 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:21.548277 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-95ed31bf-7b56-4b9a-be2b-5c138973b84e req-03d5bc6e-7ad9-4d42-a602-1472168dc221 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:21.549160 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-95ed31bf-7b56-4b9a-be2b-5c138973b84e req-03d5bc6e-7ad9-4d42-a602-1472168dc221 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:21.561551 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-95ed31bf-7b56-4b9a-be2b-5c138973b84e req-03d5bc6e-7ad9-4d42-a602-1472168dc221 service nova] Creating event network-changed:fd686c54-9ac5-4c30-b37a-16a0f75b9906 for instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 on hv-cinder-84327 Jun 22 10:23:21.567302 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-95ed31bf-7b56-4b9a-be2b-5c138973b84e req-03d5bc6e-7ad9-4d42-a602-1472168dc221 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032683 Jun 22 10:23:21.568130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 307/602] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:21.737325 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-69ffd74b-f0dd-4530-84fb-3f110eda4677 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:21.737921 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-69ffd74b-f0dd-4530-84fb-3f110eda4677 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:21.739906 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:21.745117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-69ffd74b-f0dd-4530-84fb-3f110eda4677 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:21.745700 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-69ffd74b-f0dd-4530-84fb-3f110eda4677 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:21.746522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-69ffd74b-f0dd-4530-84fb-3f110eda4677 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:21.746952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-69ffd74b-f0dd-4530-84fb-3f110eda4677 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:21.898687 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-69ffd74b-f0dd-4530-84fb-3f110eda4677 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:21.909260 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-69ffd74b-f0dd-4530-84fb-3f110eda4677 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:21.911091 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-69ffd74b-f0dd-4530-84fb-3f110eda4677 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:21.916506 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-69ffd74b-f0dd-4530-84fb-3f110eda4677 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1752 microversion: 2.20 time: 0.179049 Jun 22 10:23:21.917544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 296/603] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:21 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:22.144402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ebc43491-758f-42b8-b760-2c6efb5cf161 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:22.145125 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ebc43491-758f-42b8-b760-2c6efb5cf161 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:22.152248 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ebc43491-758f-42b8-b760-2c6efb5cf161 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:22.152693 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ebc43491-758f-42b8-b760-2c6efb5cf161 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:22.153495 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ebc43491-758f-42b8-b760-2c6efb5cf161 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:22.153924 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ebc43491-758f-42b8-b760-2c6efb5cf161 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:22.324644 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ebc43491-758f-42b8-b760-2c6efb5cf161 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:22.334003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ebc43491-758f-42b8-b760-2c6efb5cf161 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.193815 Jun 22 10:23:22.334685 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 308/604] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:22 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:22.936137 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0b9a5b50-bcd1-4200-94aa-0956b0112678 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:22.936889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0b9a5b50-bcd1-4200-94aa-0956b0112678 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:22.944613 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b9a5b50-bcd1-4200-94aa-0956b0112678 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:22.945418 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b9a5b50-bcd1-4200-94aa-0956b0112678 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:22.946283 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b9a5b50-bcd1-4200-94aa-0956b0112678 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:22.946791 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b9a5b50-bcd1-4200-94aa-0956b0112678 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:23.107914 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0b9a5b50-bcd1-4200-94aa-0956b0112678 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:23.119200 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0b9a5b50-bcd1-4200-94aa-0956b0112678 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:23.120984 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0b9a5b50-bcd1-4200-94aa-0956b0112678 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:23.122326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0b9a5b50-bcd1-4200-94aa-0956b0112678 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1752 microversion: 2.20 time: 0.190400 Jun 22 10:23:23.123177 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 297/605] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:22 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1752 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:23.351783 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f2c04f6a-6ae2-40ba-88f9-0c559cc3e371 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:23.352375 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f2c04f6a-6ae2-40ba-88f9-0c559cc3e371 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:23.354564 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=12 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:23.359691 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f2c04f6a-6ae2-40ba-88f9-0c559cc3e371 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:23.360132 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f2c04f6a-6ae2-40ba-88f9-0c559cc3e371 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:23.360940 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f2c04f6a-6ae2-40ba-88f9-0c559cc3e371 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:23.361371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f2c04f6a-6ae2-40ba-88f9-0c559cc3e371 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:23.509115 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f2c04f6a-6ae2-40ba-88f9-0c559cc3e371 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:23.517919 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f2c04f6a-6ae2-40ba-88f9-0c559cc3e371 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.169912 Jun 22 10:23:23.525874 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 309/606] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:23 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:24.142253 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bf123a16-90fc-41ce-b392-ba19dceab345 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:24.142944 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bf123a16-90fc-41ce-b392-ba19dceab345 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:24.150522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bf123a16-90fc-41ce-b392-ba19dceab345 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:24.150980 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bf123a16-90fc-41ce-b392-ba19dceab345 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:24.152049 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bf123a16-90fc-41ce-b392-ba19dceab345 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:24.152481 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bf123a16-90fc-41ce-b392-ba19dceab345 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:24.291568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bf123a16-90fc-41ce-b392-ba19dceab345 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:24.300348 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bf123a16-90fc-41ce-b392-ba19dceab345 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:24.302404 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bf123a16-90fc-41ce-b392-ba19dceab345 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:24.303568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bf123a16-90fc-41ce-b392-ba19dceab345 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1752 microversion: 2.20 time: 0.166076 Jun 22 10:23:24.314466 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 298/607] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:24 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:24.630985 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c22a0e21-6433-4435-bef5-a457765877f9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:24.630985 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c22a0e21-6433-4435-bef5-a457765877f9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:24.630985 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c22a0e21-6433-4435-bef5-a457765877f9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:24.630985 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c22a0e21-6433-4435-bef5-a457765877f9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:24.632177 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c22a0e21-6433-4435-bef5-a457765877f9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:24.632177 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c22a0e21-6433-4435-bef5-a457765877f9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:24.735155 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c22a0e21-6433-4435-bef5-a457765877f9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:24.735155 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c22a0e21-6433-4435-bef5-a457765877f9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.178192 Jun 22 10:23:24.735155 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 310/608] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:24 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:25.322153 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cfca6533-747a-40c8-8a9e-f567b236246a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:25.322793 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-cfca6533-747a-40c8-8a9e-f567b236246a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:25.329509 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cfca6533-747a-40c8-8a9e-f567b236246a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:25.329968 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cfca6533-747a-40c8-8a9e-f567b236246a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:25.330741 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cfca6533-747a-40c8-8a9e-f567b236246a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:25.331181 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cfca6533-747a-40c8-8a9e-f567b236246a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:25.465605 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cfca6533-747a-40c8-8a9e-f567b236246a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:25.474192 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cfca6533-747a-40c8-8a9e-f567b236246a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:25.475705 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cfca6533-747a-40c8-8a9e-f567b236246a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:25.476923 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cfca6533-747a-40c8-8a9e-f567b236246a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1752 microversion: 2.20 time: 0.159238 Jun 22 10:23:25.477491 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 299/609] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:25 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:25.751724 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-06acee5a-f993-495b-9a9b-eadb2f9ff407 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:25.752378 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-06acee5a-f993-495b-9a9b-eadb2f9ff407 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:25.759161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06acee5a-f993-495b-9a9b-eadb2f9ff407 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:25.759613 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06acee5a-f993-495b-9a9b-eadb2f9ff407 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:25.760379 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06acee5a-f993-495b-9a9b-eadb2f9ff407 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:25.760843 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06acee5a-f993-495b-9a9b-eadb2f9ff407 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:26.135261 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-06acee5a-f993-495b-9a9b-eadb2f9ff407 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:26.144024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-06acee5a-f993-495b-9a9b-eadb2f9ff407 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.396172 Jun 22 10:23:26.144602 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 311/610] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:25 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:26.495367 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f7285115-308a-496d-a4e0-d8f799ab927f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:26.495963 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f7285115-308a-496d-a4e0-d8f799ab927f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:26.502960 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f7285115-308a-496d-a4e0-d8f799ab927f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:26.503751 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f7285115-308a-496d-a4e0-d8f799ab927f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:26.504537 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f7285115-308a-496d-a4e0-d8f799ab927f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:26.505349 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f7285115-308a-496d-a4e0-d8f799ab927f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:26.648362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f7285115-308a-496d-a4e0-d8f799ab927f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:26.657915 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f7285115-308a-496d-a4e0-d8f799ab927f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:26.660042 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f7285115-308a-496d-a4e0-d8f799ab927f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:26.661553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f7285115-308a-496d-a4e0-d8f799ab927f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1752 microversion: 2.20 time: 0.170276 Jun 22 10:23:26.669600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 300/611] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:26 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:27.161507 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-88b4f499-7583-4ef4-9439-8d98b8a592cc tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:27.162200 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-88b4f499-7583-4ef4-9439-8d98b8a592cc tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:27.168480 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-88b4f499-7583-4ef4-9439-8d98b8a592cc tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:27.168954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-88b4f499-7583-4ef4-9439-8d98b8a592cc tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:27.169734 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-88b4f499-7583-4ef4-9439-8d98b8a592cc tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:27.170168 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-88b4f499-7583-4ef4-9439-8d98b8a592cc tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:27.329543 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-88b4f499-7583-4ef4-9439-8d98b8a592cc tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:27.338082 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-88b4f499-7583-4ef4-9439-8d98b8a592cc tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.180738 Jun 22 10:23:27.338761 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 312/612] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:27 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:27.680309 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f07cbdec-78f4-498b-b91a-35aeeca9702c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:27.695444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f07cbdec-78f4-498b-b91a-35aeeca9702c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:27.695444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f07cbdec-78f4-498b-b91a-35aeeca9702c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:27.695444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f07cbdec-78f4-498b-b91a-35aeeca9702c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:27.695444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f07cbdec-78f4-498b-b91a-35aeeca9702c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:27.696434 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f07cbdec-78f4-498b-b91a-35aeeca9702c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:27.841984 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f07cbdec-78f4-498b-b91a-35aeeca9702c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:27.852887 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f07cbdec-78f4-498b-b91a-35aeeca9702c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:27.854512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f07cbdec-78f4-498b-b91a-35aeeca9702c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:27.855740 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f07cbdec-78f4-498b-b91a-35aeeca9702c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1752 microversion: 2.20 time: 0.180009 Jun 22 10:23:27.856513 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 301/613] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:27 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:28.355410 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4c20ad76-6771-429e-9036-8cadaade80f1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:28.356001 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4c20ad76-6771-429e-9036-8cadaade80f1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:28.361930 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4c20ad76-6771-429e-9036-8cadaade80f1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:28.362371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4c20ad76-6771-429e-9036-8cadaade80f1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:28.363150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4c20ad76-6771-429e-9036-8cadaade80f1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:28.363578 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4c20ad76-6771-429e-9036-8cadaade80f1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:28.489501 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4c20ad76-6771-429e-9036-8cadaade80f1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:28.496883 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4c20ad76-6771-429e-9036-8cadaade80f1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.145421 Jun 22 10:23:28.497443 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 313/614] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:28 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:28.874479 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b6d91b1a-6863-45aa-82d5-365570aa0436 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:28.875090 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b6d91b1a-6863-45aa-82d5-365570aa0436 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:28.883082 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b6d91b1a-6863-45aa-82d5-365570aa0436 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:28.883665 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b6d91b1a-6863-45aa-82d5-365570aa0436 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:28.884695 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b6d91b1a-6863-45aa-82d5-365570aa0436 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:28.885262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b6d91b1a-6863-45aa-82d5-365570aa0436 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:29.017559 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b6d91b1a-6863-45aa-82d5-365570aa0436 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:29.026338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b6d91b1a-6863-45aa-82d5-365570aa0436 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:29.027841 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b6d91b1a-6863-45aa-82d5-365570aa0436 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:29.029032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b6d91b1a-6863-45aa-82d5-365570aa0436 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1752 microversion: 2.20 time: 0.158500 Jun 22 10:23:29.029587 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 302/615] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:28 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:29.513907 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-54b99b06-722a-4ded-ab54-d9a52d6b7486 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:29.514517 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-54b99b06-722a-4ded-ab54-d9a52d6b7486 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:29.521240 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-54b99b06-722a-4ded-ab54-d9a52d6b7486 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:29.521701 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-54b99b06-722a-4ded-ab54-d9a52d6b7486 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:29.522580 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-54b99b06-722a-4ded-ab54-d9a52d6b7486 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:29.523023 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-54b99b06-722a-4ded-ab54-d9a52d6b7486 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:29.650495 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-54b99b06-722a-4ded-ab54-d9a52d6b7486 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:29.657928 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-54b99b06-722a-4ded-ab54-d9a52d6b7486 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.147930 Jun 22 10:23:29.658498 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 314/616] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:29 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:30.047106 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-96351efc-4664-4201-8828-08c91ec701ce tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:30.047713 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-96351efc-4664-4201-8828-08c91ec701ce tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:30.054766 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-96351efc-4664-4201-8828-08c91ec701ce tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:30.055218 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-96351efc-4664-4201-8828-08c91ec701ce tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:30.055987 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-96351efc-4664-4201-8828-08c91ec701ce tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:30.056426 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-96351efc-4664-4201-8828-08c91ec701ce tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:30.196946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-96351efc-4664-4201-8828-08c91ec701ce tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:30.205493 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-96351efc-4664-4201-8828-08c91ec701ce tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:30.207003 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-96351efc-4664-4201-8828-08c91ec701ce tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:30.208683 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-96351efc-4664-4201-8828-08c91ec701ce tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1752 microversion: 2.20 time: 0.164977 Jun 22 10:23:30.209269 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 303/617] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:30 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:30.675311 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c73a5b48-dce1-4a31-92f1-5aa5c481af73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:30.675952 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c73a5b48-dce1-4a31-92f1-5aa5c481af73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:30.683039 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c73a5b48-dce1-4a31-92f1-5aa5c481af73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:30.683497 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c73a5b48-dce1-4a31-92f1-5aa5c481af73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:30.684257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c73a5b48-dce1-4a31-92f1-5aa5c481af73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:30.684685 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c73a5b48-dce1-4a31-92f1-5aa5c481af73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:30.824235 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c73a5b48-dce1-4a31-92f1-5aa5c481af73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:30.834118 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c73a5b48-dce1-4a31-92f1-5aa5c481af73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.162922 Jun 22 10:23:30.834686 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 315/618] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:30 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:31.226520 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-82c89ca9-4409-4509-857f-d8f91b4334cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:31.227125 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-82c89ca9-4409-4509-857f-d8f91b4334cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:31.233655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-82c89ca9-4409-4509-857f-d8f91b4334cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:31.234109 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-82c89ca9-4409-4509-857f-d8f91b4334cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:31.234868 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-82c89ca9-4409-4509-857f-d8f91b4334cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:31.235304 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-82c89ca9-4409-4509-857f-d8f91b4334cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:31.366842 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-82c89ca9-4409-4509-857f-d8f91b4334cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:31.370408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:31.375829 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-82c89ca9-4409-4509-857f-d8f91b4334cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:31.377372 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-82c89ca9-4409-4509-857f-d8f91b4334cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:31.385025 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-82c89ca9-4409-4509-857f-d8f91b4334cd tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1752 microversion: 2.20 time: 0.155915 Jun 22 10:23:31.385025 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 304/619] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:31 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:23:31.852218 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-de5834e1-c746-49bf-bff1-7590d3de9aa3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:31.852834 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-de5834e1-c746-49bf-bff1-7590d3de9aa3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:31.858964 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de5834e1-c746-49bf-bff1-7590d3de9aa3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:31.859404 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de5834e1-c746-49bf-bff1-7590d3de9aa3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:31.860207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de5834e1-c746-49bf-bff1-7590d3de9aa3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:31.860585 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de5834e1-c746-49bf-bff1-7590d3de9aa3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:31.987872 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-de5834e1-c746-49bf-bff1-7590d3de9aa3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:31.995873 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-de5834e1-c746-49bf-bff1-7590d3de9aa3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.147677 Jun 22 10:23:31.996430 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 316/620] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:31 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:32.401880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-75a356df-496f-49fa-a030-01460d7f9bd0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:32.402891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-75a356df-496f-49fa-a030-01460d7f9bd0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:32.410032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-75a356df-496f-49fa-a030-01460d7f9bd0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:32.410486 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-75a356df-496f-49fa-a030-01460d7f9bd0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:32.411295 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-75a356df-496f-49fa-a030-01460d7f9bd0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:32.412218 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-75a356df-496f-49fa-a030-01460d7f9bd0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:32.543148 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-75a356df-496f-49fa-a030-01460d7f9bd0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:32.552005 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-75a356df-496f-49fa-a030-01460d7f9bd0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:32.553590 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-75a356df-496f-49fa-a030-01460d7f9bd0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:32.554763 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-75a356df-496f-49fa-a030-01460d7f9bd0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1754 microversion: 2.20 time: 0.156794 Jun 22 10:23:32.555329 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 305/621] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:32 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:33.012974 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2f39eeaf-a6fc-4442-99d8-42e4a16dc4cd tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:33.013741 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2f39eeaf-a6fc-4442-99d8-42e4a16dc4cd tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:33.020451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2f39eeaf-a6fc-4442-99d8-42e4a16dc4cd tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:33.021548 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2f39eeaf-a6fc-4442-99d8-42e4a16dc4cd tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:33.022330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2f39eeaf-a6fc-4442-99d8-42e4a16dc4cd tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:33.022767 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2f39eeaf-a6fc-4442-99d8-42e4a16dc4cd tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:33.168281 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2f39eeaf-a6fc-4442-99d8-42e4a16dc4cd tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:33.171891 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2f39eeaf-a6fc-4442-99d8-42e4a16dc4cd tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.162935 Jun 22 10:23:33.172473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 317/622] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:33 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:33.573678 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5d42d812-368f-49dc-90ee-0da108700063 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:33.574282 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5d42d812-368f-49dc-90ee-0da108700063 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:33.580872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5d42d812-368f-49dc-90ee-0da108700063 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:33.581324 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5d42d812-368f-49dc-90ee-0da108700063 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:33.582092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5d42d812-368f-49dc-90ee-0da108700063 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:33.582525 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5d42d812-368f-49dc-90ee-0da108700063 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:33.713874 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5d42d812-368f-49dc-90ee-0da108700063 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:33.725292 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5d42d812-368f-49dc-90ee-0da108700063 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:33.725292 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5d42d812-368f-49dc-90ee-0da108700063 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:33.725739 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5d42d812-368f-49dc-90ee-0da108700063 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1754 microversion: 2.20 time: 0.156277 Jun 22 10:23:33.726302 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 306/623] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:33 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:23:34.189329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-10c9697d-d88b-445a-b879-42039f585c42 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:34.189939 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-10c9697d-d88b-445a-b879-42039f585c42 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:34.196621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-10c9697d-d88b-445a-b879-42039f585c42 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:34.197154 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-10c9697d-d88b-445a-b879-42039f585c42 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:34.197921 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-10c9697d-d88b-445a-b879-42039f585c42 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:34.198349 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-10c9697d-d88b-445a-b879-42039f585c42 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:34.202347 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:34.329726 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-10c9697d-d88b-445a-b879-42039f585c42 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:34.338044 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-10c9697d-d88b-445a-b879-42039f585c42 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.152534 Jun 22 10:23:34.338608 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 318/624] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:34 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:34.743579 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-de3bd87c-0512-4283-acc1-8252d02352f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:34.744189 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-de3bd87c-0512-4283-acc1-8252d02352f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:34.750797 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-de3bd87c-0512-4283-acc1-8252d02352f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:34.751251 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-de3bd87c-0512-4283-acc1-8252d02352f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:34.752019 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-de3bd87c-0512-4283-acc1-8252d02352f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:34.752458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-de3bd87c-0512-4283-acc1-8252d02352f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:34.887395 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-de3bd87c-0512-4283-acc1-8252d02352f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:34.896477 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-de3bd87c-0512-4283-acc1-8252d02352f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:34.899443 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-de3bd87c-0512-4283-acc1-8252d02352f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:34.899443 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-de3bd87c-0512-4283-acc1-8252d02352f4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1754 microversion: 2.20 time: 0.160121 Jun 22 10:23:34.899766 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 307/625] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:34 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:35.355138 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c90a01ff-816c-4893-9d60-25047af384fe tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:35.355792 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c90a01ff-816c-4893-9d60-25047af384fe tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:35.361740 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c90a01ff-816c-4893-9d60-25047af384fe tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:35.362177 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c90a01ff-816c-4893-9d60-25047af384fe tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:35.362924 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c90a01ff-816c-4893-9d60-25047af384fe tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:35.363348 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c90a01ff-816c-4893-9d60-25047af384fe tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:35.491339 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c90a01ff-816c-4893-9d60-25047af384fe tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:35.498801 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c90a01ff-816c-4893-9d60-25047af384fe tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.147540 Jun 22 10:23:35.499368 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 319/626] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:35 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:35.917946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-93063371-82d8-4097-87ca-2d51092fc4cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:35.918556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-93063371-82d8-4097-87ca-2d51092fc4cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:35.925266 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-93063371-82d8-4097-87ca-2d51092fc4cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:35.925657 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-93063371-82d8-4097-87ca-2d51092fc4cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:35.926429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-93063371-82d8-4097-87ca-2d51092fc4cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:35.926868 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-93063371-82d8-4097-87ca-2d51092fc4cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:36.060479 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-93063371-82d8-4097-87ca-2d51092fc4cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:36.069456 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-93063371-82d8-4097-87ca-2d51092fc4cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:36.084140 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-93063371-82d8-4097-87ca-2d51092fc4cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:36.084140 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-93063371-82d8-4097-87ca-2d51092fc4cb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1754 microversion: 2.20 time: 0.158067 Jun 22 10:23:36.084140 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 308/627] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:35 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:36.515474 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-42193e43-a473-4e65-baea-60110d626e8a tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:36.516080 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-42193e43-a473-4e65-baea-60110d626e8a tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:36.523257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-42193e43-a473-4e65-baea-60110d626e8a tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:36.530708 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-42193e43-a473-4e65-baea-60110d626e8a tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:36.530708 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-42193e43-a473-4e65-baea-60110d626e8a tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:36.530708 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-42193e43-a473-4e65-baea-60110d626e8a tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:36.653459 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-42193e43-a473-4e65-baea-60110d626e8a tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:36.661168 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-42193e43-a473-4e65-baea-60110d626e8a tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.149473 Jun 22 10:23:36.662253 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 320/628] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:36 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:37.091390 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3d43ffaa-10b1-458c-bdd4-fec2ab6ef274 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:37.092000 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3d43ffaa-10b1-458c-bdd4-fec2ab6ef274 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:37.100138 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3d43ffaa-10b1-458c-bdd4-fec2ab6ef274 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:37.100589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3d43ffaa-10b1-458c-bdd4-fec2ab6ef274 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:37.101379 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3d43ffaa-10b1-458c-bdd4-fec2ab6ef274 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:37.101807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3d43ffaa-10b1-458c-bdd4-fec2ab6ef274 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:37.248721 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3d43ffaa-10b1-458c-bdd4-fec2ab6ef274 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:37.259194 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3d43ffaa-10b1-458c-bdd4-fec2ab6ef274 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:37.259566 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3d43ffaa-10b1-458c-bdd4-fec2ab6ef274 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:37.260848 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3d43ffaa-10b1-458c-bdd4-fec2ab6ef274 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.174316 Jun 22 10:23:37.261418 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 309/629] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:37 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:37.679487 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-967fb1d2-4358-4e4f-9731-f7c6d86fecfa tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:37.680802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-967fb1d2-4358-4e4f-9731-f7c6d86fecfa tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:37.687215 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-967fb1d2-4358-4e4f-9731-f7c6d86fecfa tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:37.687750 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-967fb1d2-4358-4e4f-9731-f7c6d86fecfa tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:37.688522 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-967fb1d2-4358-4e4f-9731-f7c6d86fecfa tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:37.688987 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-967fb1d2-4358-4e4f-9731-f7c6d86fecfa tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:37.830140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-967fb1d2-4358-4e4f-9731-f7c6d86fecfa tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:37.837687 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-967fb1d2-4358-4e4f-9731-f7c6d86fecfa tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.162755 Jun 22 10:23:37.841183 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 321/630] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:37 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:38.286165 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-116a3d8b-5bbc-45cc-8fb4-c2b23e64097c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:38.287991 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-116a3d8b-5bbc-45cc-8fb4-c2b23e64097c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:38.302352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-116a3d8b-5bbc-45cc-8fb4-c2b23e64097c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:38.302882 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-116a3d8b-5bbc-45cc-8fb4-c2b23e64097c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:38.307413 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-116a3d8b-5bbc-45cc-8fb4-c2b23e64097c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:38.308139 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-116a3d8b-5bbc-45cc-8fb4-c2b23e64097c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:38.479492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-116a3d8b-5bbc-45cc-8fb4-c2b23e64097c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:38.491395 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-116a3d8b-5bbc-45cc-8fb4-c2b23e64097c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:38.493339 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-116a3d8b-5bbc-45cc-8fb4-c2b23e64097c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:38.494698 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-116a3d8b-5bbc-45cc-8fb4-c2b23e64097c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.212595 Jun 22 10:23:38.506091 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 310/631] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:38 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:38.854877 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-db9d56f3-74b2-40b3-ba97-4a6ace7218f3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:38.856177 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-db9d56f3-74b2-40b3-ba97-4a6ace7218f3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:38.862681 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-db9d56f3-74b2-40b3-ba97-4a6ace7218f3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:38.863133 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-db9d56f3-74b2-40b3-ba97-4a6ace7218f3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:38.863917 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-db9d56f3-74b2-40b3-ba97-4a6ace7218f3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:38.864348 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-db9d56f3-74b2-40b3-ba97-4a6ace7218f3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:39.018043 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-db9d56f3-74b2-40b3-ba97-4a6ace7218f3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:39.027787 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-db9d56f3-74b2-40b3-ba97-4a6ace7218f3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.176734 Jun 22 10:23:39.028410 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 322/632] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:38 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:39.515603 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c94bd291-5287-4b91-b12e-c4ec7e2c0ac2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:39.517012 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c94bd291-5287-4b91-b12e-c4ec7e2c0ac2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:39.523672 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c94bd291-5287-4b91-b12e-c4ec7e2c0ac2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:39.524120 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c94bd291-5287-4b91-b12e-c4ec7e2c0ac2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:39.524922 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c94bd291-5287-4b91-b12e-c4ec7e2c0ac2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:39.525364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c94bd291-5287-4b91-b12e-c4ec7e2c0ac2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:39.676182 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c94bd291-5287-4b91-b12e-c4ec7e2c0ac2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:39.690574 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c94bd291-5287-4b91-b12e-c4ec7e2c0ac2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:39.692148 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c94bd291-5287-4b91-b12e-c4ec7e2c0ac2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:39.693850 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c94bd291-5287-4b91-b12e-c4ec7e2c0ac2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.183542 Jun 22 10:23:39.694699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 311/633] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:39 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:39.765413 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-b98a6b96-8d09-40ba-8ee7-ccfbe5730c51 req-84d6547b-26eb-4651-8de8-bde10ffe8444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4e73d9-0607-4ae9-8fb5-30bd61f928f1", "name": "network-vif-plugged", "status": "completed", "tag": "249b9885-08e1-4d0f-8a26-3a03a7f683a3"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:39.782681 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-b98a6b96-8d09-40ba-8ee7-ccfbe5730c51 req-84d6547b-26eb-4651-8de8-bde10ffe8444 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:39.782681 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-b98a6b96-8d09-40ba-8ee7-ccfbe5730c51 req-84d6547b-26eb-4651-8de8-bde10ffe8444 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:39.795154 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-b98a6b96-8d09-40ba-8ee7-ccfbe5730c51 req-84d6547b-26eb-4651-8de8-bde10ffe8444 service nova] Creating event network-vif-plugged:249b9885-08e1-4d0f-8a26-3a03a7f683a3 for instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 on hv-cinder-84327 Jun 22 10:23:39.801149 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-b98a6b96-8d09-40ba-8ee7-ccfbe5730c51 req-84d6547b-26eb-4651-8de8-bde10ffe8444 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039504 Jun 22 10:23:39.801752 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 323/634] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:40.045723 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-81725606-c944-4c38-8a7e-88b78fe60361 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:40.046701 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-81725606-c944-4c38-8a7e-88b78fe60361 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:40.053287 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-81725606-c944-4c38-8a7e-88b78fe60361 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:40.054023 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-81725606-c944-4c38-8a7e-88b78fe60361 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:40.054859 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-81725606-c944-4c38-8a7e-88b78fe60361 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:40.055303 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-81725606-c944-4c38-8a7e-88b78fe60361 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:40.202175 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-81725606-c944-4c38-8a7e-88b78fe60361 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:40.210039 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-81725606-c944-4c38-8a7e-88b78fe60361 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.168300 Jun 22 10:23:40.210614 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 312/635] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:40 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:40.713485 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-825ca5a6-886f-4f85-854f-a6e992ca253a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:40.714270 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-825ca5a6-886f-4f85-854f-a6e992ca253a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:40.721902 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-825ca5a6-886f-4f85-854f-a6e992ca253a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:40.722443 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-825ca5a6-886f-4f85-854f-a6e992ca253a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:40.723307 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-825ca5a6-886f-4f85-854f-a6e992ca253a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:40.723816 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-825ca5a6-886f-4f85-854f-a6e992ca253a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:40.863591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-825ca5a6-886f-4f85-854f-a6e992ca253a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:40.875624 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-825ca5a6-886f-4f85-854f-a6e992ca253a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:40.877165 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-825ca5a6-886f-4f85-854f-a6e992ca253a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:40.878540 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-825ca5a6-886f-4f85-854f-a6e992ca253a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.169294 Jun 22 10:23:40.879116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 324/636] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:40 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:41.227876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0e4d0368-d710-4e28-8392-9bf5c3e9e6c2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:41.228564 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0e4d0368-d710-4e28-8392-9bf5c3e9e6c2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:41.235600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0e4d0368-d710-4e28-8392-9bf5c3e9e6c2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:41.236049 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0e4d0368-d710-4e28-8392-9bf5c3e9e6c2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:41.236845 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0e4d0368-d710-4e28-8392-9bf5c3e9e6c2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:41.237278 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0e4d0368-d710-4e28-8392-9bf5c3e9e6c2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:41.377837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0e4d0368-d710-4e28-8392-9bf5c3e9e6c2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:41.385672 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0e4d0368-d710-4e28-8392-9bf5c3e9e6c2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.162356 Jun 22 10:23:41.386447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 313/637] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:41 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:41.898202 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4de0f971-93ad-4dca-b895-d32b6f23b210 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:41.898847 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4de0f971-93ad-4dca-b895-d32b6f23b210 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:41.905653 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4de0f971-93ad-4dca-b895-d32b6f23b210 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:41.906190 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4de0f971-93ad-4dca-b895-d32b6f23b210 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:41.907043 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4de0f971-93ad-4dca-b895-d32b6f23b210 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:41.907486 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4de0f971-93ad-4dca-b895-d32b6f23b210 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:42.044778 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4de0f971-93ad-4dca-b895-d32b6f23b210 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:42.054361 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4de0f971-93ad-4dca-b895-d32b6f23b210 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:42.055875 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4de0f971-93ad-4dca-b895-d32b6f23b210 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:42.057240 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4de0f971-93ad-4dca-b895-d32b6f23b210 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.163464 Jun 22 10:23:42.057993 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 325/638] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:41 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:42.402032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f3e63b34-573e-48db-a0ca-7c4278305fea tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:42.402627 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f3e63b34-573e-48db-a0ca-7c4278305fea tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:42.409468 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f3e63b34-573e-48db-a0ca-7c4278305fea tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:42.409922 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f3e63b34-573e-48db-a0ca-7c4278305fea tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:42.410693 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f3e63b34-573e-48db-a0ca-7c4278305fea tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:42.411127 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f3e63b34-573e-48db-a0ca-7c4278305fea tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:42.546406 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f3e63b34-573e-48db-a0ca-7c4278305fea tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:42.554986 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f3e63b34-573e-48db-a0ca-7c4278305fea tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.156826 Jun 22 10:23:42.555567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 314/639] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:42 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:43.075141 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8783d19f-4088-47d9-b8a9-f46ba09bcbde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:43.075832 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8783d19f-4088-47d9-b8a9-f46ba09bcbde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:43.081942 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8783d19f-4088-47d9-b8a9-f46ba09bcbde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:43.082390 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8783d19f-4088-47d9-b8a9-f46ba09bcbde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:43.083150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8783d19f-4088-47d9-b8a9-f46ba09bcbde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:43.084088 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8783d19f-4088-47d9-b8a9-f46ba09bcbde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:43.238400 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8783d19f-4088-47d9-b8a9-f46ba09bcbde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:43.247484 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8783d19f-4088-47d9-b8a9-f46ba09bcbde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:43.249025 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8783d19f-4088-47d9-b8a9-f46ba09bcbde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:43.250201 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8783d19f-4088-47d9-b8a9-f46ba09bcbde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.178956 Jun 22 10:23:43.250781 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 326/640] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:43 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:43.573106 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6596a5b2-3263-4362-be90-e45ef435ec5f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:43.573881 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6596a5b2-3263-4362-be90-e45ef435ec5f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:43.580586 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6596a5b2-3263-4362-be90-e45ef435ec5f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:43.581193 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6596a5b2-3263-4362-be90-e45ef435ec5f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:43.581864 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6596a5b2-3263-4362-be90-e45ef435ec5f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:43.582302 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6596a5b2-3263-4362-be90-e45ef435ec5f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:43.722496 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6596a5b2-3263-4362-be90-e45ef435ec5f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:43.730647 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6596a5b2-3263-4362-be90-e45ef435ec5f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.162483 Jun 22 10:23:43.731228 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 315/641] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:43 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:44.270150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-33bca5ca-a61b-4727-93f1-56f2f9e97405 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:44.270791 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-33bca5ca-a61b-4727-93f1-56f2f9e97405 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:44.277668 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-33bca5ca-a61b-4727-93f1-56f2f9e97405 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:44.278116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-33bca5ca-a61b-4727-93f1-56f2f9e97405 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:44.278908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-33bca5ca-a61b-4727-93f1-56f2f9e97405 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:44.279395 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-33bca5ca-a61b-4727-93f1-56f2f9e97405 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:44.419316 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-33bca5ca-a61b-4727-93f1-56f2f9e97405 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:44.432659 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-33bca5ca-a61b-4727-93f1-56f2f9e97405 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:44.434198 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-33bca5ca-a61b-4727-93f1-56f2f9e97405 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:44.435365 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-33bca5ca-a61b-4727-93f1-56f2f9e97405 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.169381 Jun 22 10:23:44.435916 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 327/642] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:44 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:44.747849 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8bdb784c-f290-4165-8fe0-27fee5161f96 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:44.749231 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8bdb784c-f290-4165-8fe0-27fee5161f96 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:44.757294 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8bdb784c-f290-4165-8fe0-27fee5161f96 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:44.758102 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8bdb784c-f290-4165-8fe0-27fee5161f96 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:44.759199 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8bdb784c-f290-4165-8fe0-27fee5161f96 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:44.759855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8bdb784c-f290-4165-8fe0-27fee5161f96 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:44.905862 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8bdb784c-f290-4165-8fe0-27fee5161f96 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:44.915136 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-8bdb784c-f290-4165-8fe0-27fee5161f96 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.171224 Jun 22 10:23:44.917373 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 316/643] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:44 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:45.454210 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-289d0955-15ab-4f57-a02c-c29e9adc5a28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:45.454955 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-289d0955-15ab-4f57-a02c-c29e9adc5a28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:45.461240 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-289d0955-15ab-4f57-a02c-c29e9adc5a28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:45.461695 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-289d0955-15ab-4f57-a02c-c29e9adc5a28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:45.462485 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-289d0955-15ab-4f57-a02c-c29e9adc5a28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:45.462917 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-289d0955-15ab-4f57-a02c-c29e9adc5a28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:45.606520 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-289d0955-15ab-4f57-a02c-c29e9adc5a28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:45.616246 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-289d0955-15ab-4f57-a02c-c29e9adc5a28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:45.617822 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-289d0955-15ab-4f57-a02c-c29e9adc5a28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:45.618997 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-289d0955-15ab-4f57-a02c-c29e9adc5a28 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.168834 Jun 22 10:23:45.619771 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 328/644] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:45 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:45.933878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5f08e331-109e-438c-bcad-f3a5f4625b73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:45.934535 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5f08e331-109e-438c-bcad-f3a5f4625b73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:45.941349 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5f08e331-109e-438c-bcad-f3a5f4625b73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:45.941796 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5f08e331-109e-438c-bcad-f3a5f4625b73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:45.942578 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5f08e331-109e-438c-bcad-f3a5f4625b73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:45.943015 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5f08e331-109e-438c-bcad-f3a5f4625b73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:46.075860 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5f08e331-109e-438c-bcad-f3a5f4625b73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:46.084044 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5f08e331-109e-438c-bcad-f3a5f4625b73 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.153446 Jun 22 10:23:46.084556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 317/645] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:45 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:46.641625 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0170aa8d-e17d-4709-abc2-1183a3fe22ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:46.642596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0170aa8d-e17d-4709-abc2-1183a3fe22ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:46.652775 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0170aa8d-e17d-4709-abc2-1183a3fe22ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:46.653586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0170aa8d-e17d-4709-abc2-1183a3fe22ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:46.654875 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0170aa8d-e17d-4709-abc2-1183a3fe22ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:46.655614 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0170aa8d-e17d-4709-abc2-1183a3fe22ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:46.820240 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0170aa8d-e17d-4709-abc2-1183a3fe22ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:46.830500 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0170aa8d-e17d-4709-abc2-1183a3fe22ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:46.832773 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0170aa8d-e17d-4709-abc2-1183a3fe22ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:46.834461 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0170aa8d-e17d-4709-abc2-1183a3fe22ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.200223 Jun 22 10:23:46.835263 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 329/646] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:46 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:47.100929 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3b758210-9179-4cb3-8c25-4c8ff466aa30 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:47.101606 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3b758210-9179-4cb3-8c25-4c8ff466aa30 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:47.108775 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3b758210-9179-4cb3-8c25-4c8ff466aa30 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:47.109288 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3b758210-9179-4cb3-8c25-4c8ff466aa30 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:47.110089 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3b758210-9179-4cb3-8c25-4c8ff466aa30 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:47.110523 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3b758210-9179-4cb3-8c25-4c8ff466aa30 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:47.268477 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3b758210-9179-4cb3-8c25-4c8ff466aa30 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:47.277089 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3b758210-9179-4cb3-8c25-4c8ff466aa30 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.179959 Jun 22 10:23:47.278238 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 318/647] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:47 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:47.611357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bb1ffa25-dc34-4b91-8ca6-2e5073ab9f65 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27521dce-bad8-4675-9f87-2190bd984c2c"}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:47.613217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bb1ffa25-dc34-4b91-8ca6-2e5073ab9f65 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:47.622539 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb1ffa25-dc34-4b91-8ca6-2e5073ab9f65 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:47.622994 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb1ffa25-dc34-4b91-8ca6-2e5073ab9f65 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:47.623775 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb1ffa25-dc34-4b91-8ca6-2e5073ab9f65 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:47.624218 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb1ffa25-dc34-4b91-8ca6-2e5073ab9f65 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:47.853393 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b3598b71-dc01-4fb2-8d4c-03a535fa418a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:47.854005 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b3598b71-dc01-4fb2-8d4c-03a535fa418a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:47.860277 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b3598b71-dc01-4fb2-8d4c-03a535fa418a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:47.860750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b3598b71-dc01-4fb2-8d4c-03a535fa418a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:47.861557 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b3598b71-dc01-4fb2-8d4c-03a535fa418a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:47.861986 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b3598b71-dc01-4fb2-8d4c-03a535fa418a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:47.998935 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b3598b71-dc01-4fb2-8d4c-03a535fa418a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:48.008415 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b3598b71-dc01-4fb2-8d4c-03a535fa418a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:48.009950 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b3598b71-dc01-4fb2-8d4c-03a535fa418a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:48.011121 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b3598b71-dc01-4fb2-8d4c-03a535fa418a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.162328 Jun 22 10:23:48.020921 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 319/648] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:47 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:23:48.294181 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-802e8637-ec1b-4675-9a4d-207aa58d5fde tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:48.294871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-802e8637-ec1b-4675-9a4d-207aa58d5fde tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:48.301427 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-802e8637-ec1b-4675-9a4d-207aa58d5fde tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:48.301875 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-802e8637-ec1b-4675-9a4d-207aa58d5fde tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:48.303164 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-802e8637-ec1b-4675-9a4d-207aa58d5fde tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:48.303589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-802e8637-ec1b-4675-9a4d-207aa58d5fde tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:48.443468 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-802e8637-ec1b-4675-9a4d-207aa58d5fde tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:48.451500 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-802e8637-ec1b-4675-9a4d-207aa58d5fde tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.161003 Jun 22 10:23:48.452429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 320/649] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:48 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:49.029797 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-dc8de191-ee33-428d-a9dd-cf574256fb78 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:49.030470 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-dc8de191-ee33-428d-a9dd-cf574256fb78 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:49.032313 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=60 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:49.038024 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dc8de191-ee33-428d-a9dd-cf574256fb78 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:49.038476 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dc8de191-ee33-428d-a9dd-cf574256fb78 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:49.039247 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dc8de191-ee33-428d-a9dd-cf574256fb78 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:49.039691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dc8de191-ee33-428d-a9dd-cf574256fb78 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:49.059010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:49.170716 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-dc8de191-ee33-428d-a9dd-cf574256fb78 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:49.179075 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-dc8de191-ee33-428d-a9dd-cf574256fb78 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:49.180620 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-dc8de191-ee33-428d-a9dd-cf574256fb78 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:49.181779 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-dc8de191-ee33-428d-a9dd-cf574256fb78 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.155947 Jun 22 10:23:49.182494 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 321/650] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:49 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:23:49.468614 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-85b89e96-c91b-4a05-a969-0f0ab8a98a53 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:49.469273 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-85b89e96-c91b-4a05-a969-0f0ab8a98a53 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:49.475878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-85b89e96-c91b-4a05-a969-0f0ab8a98a53 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:49.476321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-85b89e96-c91b-4a05-a969-0f0ab8a98a53 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:49.477135 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-85b89e96-c91b-4a05-a969-0f0ab8a98a53 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:49.477614 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-85b89e96-c91b-4a05-a969-0f0ab8a98a53 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:49.602921 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-85b89e96-c91b-4a05-a969-0f0ab8a98a53 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:49.610532 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-85b89e96-c91b-4a05-a969-0f0ab8a98a53 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.146196 Jun 22 10:23:49.611105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 322/651] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:49 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:50.199091 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-29ba40c6-dea6-4d62-9d3d-c25fd0a90e2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:50.199616 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-29ba40c6-dea6-4d62-9d3d-c25fd0a90e2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:50.205789 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-29ba40c6-dea6-4d62-9d3d-c25fd0a90e2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:50.206237 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-29ba40c6-dea6-4d62-9d3d-c25fd0a90e2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:50.207000 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-29ba40c6-dea6-4d62-9d3d-c25fd0a90e2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:50.207438 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-29ba40c6-dea6-4d62-9d3d-c25fd0a90e2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:50.340245 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-29ba40c6-dea6-4d62-9d3d-c25fd0a90e2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:50.348741 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-29ba40c6-dea6-4d62-9d3d-c25fd0a90e2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:50.350852 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-29ba40c6-dea6-4d62-9d3d-c25fd0a90e2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:50.352041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-29ba40c6-dea6-4d62-9d3d-c25fd0a90e2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.156969 Jun 22 10:23:50.352594 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 323/652] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:50 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:23:50.627420 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-befc621d-b9bd-4ed1-aba5-a48625a423b7 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:50.628106 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-befc621d-b9bd-4ed1-aba5-a48625a423b7 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:50.635243 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-befc621d-b9bd-4ed1-aba5-a48625a423b7 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:50.635689 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-befc621d-b9bd-4ed1-aba5-a48625a423b7 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:50.636441 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-befc621d-b9bd-4ed1-aba5-a48625a423b7 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:50.636891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-befc621d-b9bd-4ed1-aba5-a48625a423b7 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:50.782201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-befc621d-b9bd-4ed1-aba5-a48625a423b7 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:50.782201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-befc621d-b9bd-4ed1-aba5-a48625a423b7 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.153349 Jun 22 10:23:50.782201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 324/653] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:50 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:51.370847 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-075c04cd-6da8-4f5d-bac6-6b27b6cb4b95 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:51.371460 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-075c04cd-6da8-4f5d-bac6-6b27b6cb4b95 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:51.379133 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-075c04cd-6da8-4f5d-bac6-6b27b6cb4b95 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:51.379769 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-075c04cd-6da8-4f5d-bac6-6b27b6cb4b95 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:51.381693 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-075c04cd-6da8-4f5d-bac6-6b27b6cb4b95 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:51.382264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-075c04cd-6da8-4f5d-bac6-6b27b6cb4b95 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:51.524419 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-075c04cd-6da8-4f5d-bac6-6b27b6cb4b95 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:51.532955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-075c04cd-6da8-4f5d-bac6-6b27b6cb4b95 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:51.534521 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-075c04cd-6da8-4f5d-bac6-6b27b6cb4b95 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:51.537446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-075c04cd-6da8-4f5d-bac6-6b27b6cb4b95 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.170076 Jun 22 10:23:51.538017 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 325/654] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:51 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:23:51.794322 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8c5c21b1-9d0e-44ce-a428-aee5cf75c2a9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:51.794993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8c5c21b1-9d0e-44ce-a428-aee5cf75c2a9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:51.802147 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8c5c21b1-9d0e-44ce-a428-aee5cf75c2a9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:51.814945 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8c5c21b1-9d0e-44ce-a428-aee5cf75c2a9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:51.814945 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8c5c21b1-9d0e-44ce-a428-aee5cf75c2a9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:51.814945 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8c5c21b1-9d0e-44ce-a428-aee5cf75c2a9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:51.934095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8c5c21b1-9d0e-44ce-a428-aee5cf75c2a9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:51.941668 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-8c5c21b1-9d0e-44ce-a428-aee5cf75c2a9 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.151342 Jun 22 10:23:51.942883 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 326/655] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:51 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:52.555770 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d3dffe81-bb51-4825-9d81-978896e8a09e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:52.556380 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d3dffe81-bb51-4825-9d81-978896e8a09e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:52.562525 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d3dffe81-bb51-4825-9d81-978896e8a09e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:52.562979 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d3dffe81-bb51-4825-9d81-978896e8a09e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:52.563739 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d3dffe81-bb51-4825-9d81-978896e8a09e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:52.564183 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d3dffe81-bb51-4825-9d81-978896e8a09e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:52.698681 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d3dffe81-bb51-4825-9d81-978896e8a09e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:52.707226 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d3dffe81-bb51-4825-9d81-978896e8a09e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:52.709243 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d3dffe81-bb51-4825-9d81-978896e8a09e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:52.716043 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d3dffe81-bb51-4825-9d81-978896e8a09e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.158751 Jun 22 10:23:52.716043 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 327/656] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:52 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:23:52.959825 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-df616a7f-d60a-43d0-a045-a1517ba68459 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:52.960453 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-df616a7f-d60a-43d0-a045-a1517ba68459 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:52.967004 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-df616a7f-d60a-43d0-a045-a1517ba68459 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:52.967454 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-df616a7f-d60a-43d0-a045-a1517ba68459 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:52.968225 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-df616a7f-d60a-43d0-a045-a1517ba68459 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:52.968665 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-df616a7f-d60a-43d0-a045-a1517ba68459 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:53.100266 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-df616a7f-d60a-43d0-a045-a1517ba68459 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:53.108181 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-df616a7f-d60a-43d0-a045-a1517ba68459 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.152809 Jun 22 10:23:53.108757 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 328/657] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:52 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:53.729473 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3223429d-d736-4302-8403-27ec9b4aa80f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:53.729995 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3223429d-d736-4302-8403-27ec9b4aa80f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:53.736091 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3223429d-d736-4302-8403-27ec9b4aa80f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:53.736536 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3223429d-d736-4302-8403-27ec9b4aa80f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:53.737314 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3223429d-d736-4302-8403-27ec9b4aa80f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:53.737737 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3223429d-d736-4302-8403-27ec9b4aa80f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:53.870545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3223429d-d736-4302-8403-27ec9b4aa80f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:53.879804 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3223429d-d736-4302-8403-27ec9b4aa80f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:53.881483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3223429d-d736-4302-8403-27ec9b4aa80f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:53.882701 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3223429d-d736-4302-8403-27ec9b4aa80f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.157117 Jun 22 10:23:53.883623 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 329/658] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:53 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:23:54.124446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fdbef865-91a7-4792-95e0-585725c8deb2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:54.125216 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-fdbef865-91a7-4792-95e0-585725c8deb2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:54.131728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fdbef865-91a7-4792-95e0-585725c8deb2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:54.135458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fdbef865-91a7-4792-95e0-585725c8deb2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:54.135458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fdbef865-91a7-4792-95e0-585725c8deb2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:54.135458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fdbef865-91a7-4792-95e0-585725c8deb2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:54.267996 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-fdbef865-91a7-4792-95e0-585725c8deb2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:54.276213 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-fdbef865-91a7-4792-95e0-585725c8deb2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.155512 Jun 22 10:23:54.276855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 330/659] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:54 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:54.369905 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bb1ffa25-dc34-4b91-8ca6-2e5073ab9f65 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "POST /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.887479 Jun 22 10:23:54.370546 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 330/660] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:23:47 2022] POST /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments => generated 194 bytes in 6889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:54.901032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ab65ad8e-2987-4b38-9945-1fb31ab8431c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:54.901824 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ab65ad8e-2987-4b38-9945-1fb31ab8431c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:54.908396 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab65ad8e-2987-4b38-9945-1fb31ab8431c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:54.908874 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab65ad8e-2987-4b38-9945-1fb31ab8431c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:54.909973 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab65ad8e-2987-4b38-9945-1fb31ab8431c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:54.910404 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab65ad8e-2987-4b38-9945-1fb31ab8431c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:55.054299 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ab65ad8e-2987-4b38-9945-1fb31ab8431c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:55.062933 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ab65ad8e-2987-4b38-9945-1fb31ab8431c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:55.064475 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ab65ad8e-2987-4b38-9945-1fb31ab8431c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:55.065702 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ab65ad8e-2987-4b38-9945-1fb31ab8431c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.169352 Jun 22 10:23:55.066266 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 331/661] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:54 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:55.294010 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8b258ea2-2285-4ad6-a820-b0e3ed3631c8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:55.294735 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8b258ea2-2285-4ad6-a820-b0e3ed3631c8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:55.296668 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=58 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:55.302197 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8b258ea2-2285-4ad6-a820-b0e3ed3631c8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:55.302649 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8b258ea2-2285-4ad6-a820-b0e3ed3631c8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:55.303495 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8b258ea2-2285-4ad6-a820-b0e3ed3631c8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:55.303934 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8b258ea2-2285-4ad6-a820-b0e3ed3631c8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:55.436751 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8b258ea2-2285-4ad6-a820-b0e3ed3631c8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:55.446591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8b258ea2-2285-4ad6-a820-b0e3ed3631c8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1358 microversion: 2.1 time: 0.154948 Jun 22 10:23:55.446591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 331/662] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:55 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:56.084215 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-66b1bb87-139c-40c7-8078-b13261faba14 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:56.084847 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-66b1bb87-139c-40c7-8078-b13261faba14 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:56.091339 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-66b1bb87-139c-40c7-8078-b13261faba14 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:56.091788 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-66b1bb87-139c-40c7-8078-b13261faba14 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:56.092544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-66b1bb87-139c-40c7-8078-b13261faba14 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:56.093025 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-66b1bb87-139c-40c7-8078-b13261faba14 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:56.220191 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-66b1bb87-139c-40c7-8078-b13261faba14 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:56.229305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-66b1bb87-139c-40c7-8078-b13261faba14 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:56.230798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-66b1bb87-139c-40c7-8078-b13261faba14 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:56.231938 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-66b1bb87-139c-40c7-8078-b13261faba14 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.151963 Jun 22 10:23:56.232484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 332/663] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:56 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:56.462443 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-77cb3018-c975-4e79-b272-16faf5626603 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:56.463055 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-77cb3018-c975-4e79-b272-16faf5626603 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:56.469972 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77cb3018-c975-4e79-b272-16faf5626603 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:56.470285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77cb3018-c975-4e79-b272-16faf5626603 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:56.471058 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77cb3018-c975-4e79-b272-16faf5626603 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:56.471492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77cb3018-c975-4e79-b272-16faf5626603 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:56.603466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-77cb3018-c975-4e79-b272-16faf5626603 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:56.610914 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-77cb3018-c975-4e79-b272-16faf5626603 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1548 microversion: 2.1 time: 0.152941 Jun 22 10:23:56.611481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 332/664] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:56 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:56.626782 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-62be9583-a25d-4fc2-bf0f-d96d17cdadf4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:56.627423 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-62be9583-a25d-4fc2-bf0f-d96d17cdadf4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:56.634098 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-62be9583-a25d-4fc2-bf0f-d96d17cdadf4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:56.634545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-62be9583-a25d-4fc2-bf0f-d96d17cdadf4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:56.635308 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-62be9583-a25d-4fc2-bf0f-d96d17cdadf4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:56.635739 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-62be9583-a25d-4fc2-bf0f-d96d17cdadf4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:56.767385 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-62be9583-a25d-4fc2-bf0f-d96d17cdadf4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:56.775568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-62be9583-a25d-4fc2-bf0f-d96d17cdadf4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1548 microversion: 2.1 time: 0.152587 Jun 22 10:23:56.776143 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 333/665] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:56 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:56.791345 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-04b1160e-338f-42c2-8a60-0f539758310f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:56.794862 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-04b1160e-338f-42c2-8a60-0f539758310f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:56.795689 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-04b1160e-338f-42c2-8a60-0f539758310f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Searching by: {'deleted': False, 'project_id': '9dfa249b41a8422fae46988649977e6e'} {{(pid=118326) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 22 10:23:56.802280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-04b1160e-338f-42c2-8a60-0f539758310f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:56.802696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-04b1160e-338f-42c2-8a60-0f539758310f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:56.803487 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-04b1160e-338f-42c2-8a60-0f539758310f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:56.803903 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-04b1160e-338f-42c2-8a60-0f539758310f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:56.894090 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.multi_cell_list [None req-04b1160e-338f-42c2-8a60-0f539758310f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118326) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 22 10:23:56.969682 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:56.986387 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-04b1160e-338f-42c2-8a60-0f539758310f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197471 Jun 22 10:23:56.986387 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 333/666] 10.222.0.46 () {58 vars in 1124 bytes} [Wed Jun 22 10:23:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:56.996183 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2732561d-76ab-4b35-835c-8f14e6ffad55 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:56.996798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2732561d-76ab-4b35-835c-8f14e6ffad55 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:57.002872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2732561d-76ab-4b35-835c-8f14e6ffad55 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:57.003319 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2732561d-76ab-4b35-835c-8f14e6ffad55 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:57.004158 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2732561d-76ab-4b35-835c-8f14e6ffad55 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:57.004592 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2732561d-76ab-4b35-835c-8f14e6ffad55 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:57.131420 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2732561d-76ab-4b35-835c-8f14e6ffad55 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:57.139077 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2732561d-76ab-4b35-835c-8f14e6ffad55 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1548 microversion: 2.1 time: 0.146665 Jun 22 10:23:57.139654 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 334/667] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:56 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:57.250768 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d00ec657-6d9e-446b-ae15-bb22cfd3034c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:57.251303 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d00ec657-6d9e-446b-ae15-bb22cfd3034c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:57.258215 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d00ec657-6d9e-446b-ae15-bb22cfd3034c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:57.258661 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d00ec657-6d9e-446b-ae15-bb22cfd3034c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:57.259432 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d00ec657-6d9e-446b-ae15-bb22cfd3034c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:57.259875 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d00ec657-6d9e-446b-ae15-bb22cfd3034c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:57.394765 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d00ec657-6d9e-446b-ae15-bb22cfd3034c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:57.403564 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d00ec657-6d9e-446b-ae15-bb22cfd3034c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:57.405125 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d00ec657-6d9e-446b-ae15-bb22cfd3034c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:57.406295 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d00ec657-6d9e-446b-ae15-bb22cfd3034c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.159835 Jun 22 10:23:57.406858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 334/668] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:57 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:58.426647 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9d41fce1-51b2-4dc1-8180-af182e50ab4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:58.427262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9d41fce1-51b2-4dc1-8180-af182e50ab4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:58.434430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d41fce1-51b2-4dc1-8180-af182e50ab4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:58.434881 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d41fce1-51b2-4dc1-8180-af182e50ab4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:58.435706 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d41fce1-51b2-4dc1-8180-af182e50ab4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:58.436149 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d41fce1-51b2-4dc1-8180-af182e50ab4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:58.565553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9d41fce1-51b2-4dc1-8180-af182e50ab4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:58.573956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9d41fce1-51b2-4dc1-8180-af182e50ab4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:58.575455 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9d41fce1-51b2-4dc1-8180-af182e50ab4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:58.576602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9d41fce1-51b2-4dc1-8180-af182e50ab4e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.154010 Jun 22 10:23:58.577209 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 335/669] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:58 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:23:59.595622 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ca21a476-73e4-4624-9ddf-42c1ee3ae041 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:59.596220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ca21a476-73e4-4624-9ddf-42c1ee3ae041 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:59.603144 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ca21a476-73e4-4624-9ddf-42c1ee3ae041 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:59.607156 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ca21a476-73e4-4624-9ddf-42c1ee3ae041 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:59.607156 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ca21a476-73e4-4624-9ddf-42c1ee3ae041 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:59.607156 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ca21a476-73e4-4624-9ddf-42c1ee3ae041 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:59.742544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ca21a476-73e4-4624-9ddf-42c1ee3ae041 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:59.750939 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ca21a476-73e4-4624-9ddf-42c1ee3ae041 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:59.752441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ca21a476-73e4-4624-9ddf-42c1ee3ae041 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:59.753615 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ca21a476-73e4-4624-9ddf-42c1ee3ae041 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.161902 Jun 22 10:23:59.754178 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 335/670] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:23:59 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:24:00.284328 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d9e26c3a-febc-4d2f-87dc-3d8e12508350 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "661d98d1-92c9-4102-bcd7-b401e04f18f5"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:00.285775 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d9e26c3a-febc-4d2f-87dc-3d8e12508350 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:00.292166 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d9e26c3a-febc-4d2f-87dc-3d8e12508350 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:00.292614 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d9e26c3a-febc-4d2f-87dc-3d8e12508350 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:00.293409 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d9e26c3a-febc-4d2f-87dc-3d8e12508350 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:00.293845 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d9e26c3a-febc-4d2f-87dc-3d8e12508350 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:00.772112 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-be0362b7-d1ba-4907-994b-aa87216c7683 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:00.772696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-be0362b7-d1ba-4907-994b-aa87216c7683 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:00.779148 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-be0362b7-d1ba-4907-994b-aa87216c7683 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:00.779590 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-be0362b7-d1ba-4907-994b-aa87216c7683 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:00.780346 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-be0362b7-d1ba-4907-994b-aa87216c7683 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:00.780773 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-be0362b7-d1ba-4907-994b-aa87216c7683 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:00.924335 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-be0362b7-d1ba-4907-994b-aa87216c7683 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:00.932739 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-be0362b7-d1ba-4907-994b-aa87216c7683 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:00.934271 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-be0362b7-d1ba-4907-994b-aa87216c7683 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:00.935417 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-be0362b7-d1ba-4907-994b-aa87216c7683 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.167778 Jun 22 10:24:00.935972 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 336/671] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:24:00 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:24:01.345345 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:01.428553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d9e26c3a-febc-4d2f-87dc-3d8e12508350 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "POST /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.148005 Jun 22 10:24:01.429259 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 336/672] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:24:00 2022] POST /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments => generated 194 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:01.952986 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0333ea7a-9a93-48d4-a409-17ac9751f5d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:01.953696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0333ea7a-9a93-48d4-a409-17ac9751f5d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:01.960418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0333ea7a-9a93-48d4-a409-17ac9751f5d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:01.960892 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0333ea7a-9a93-48d4-a409-17ac9751f5d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:01.961664 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0333ea7a-9a93-48d4-a409-17ac9751f5d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:01.962106 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0333ea7a-9a93-48d4-a409-17ac9751f5d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:02.093227 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0333ea7a-9a93-48d4-a409-17ac9751f5d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:02.102411 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0333ea7a-9a93-48d4-a409-17ac9751f5d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:02.103909 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0333ea7a-9a93-48d4-a409-17ac9751f5d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:02.105091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0333ea7a-9a93-48d4-a409-17ac9751f5d7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.156172 Jun 22 10:24:02.105655 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 337/673] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:24:01 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:24:02.928999 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-42d23494-096d-46a5-9cbd-ab7a3035d06a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:02.930143 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-42d23494-096d-46a5-9cbd-ab7a3035d06a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:02.937444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-42d23494-096d-46a5-9cbd-ab7a3035d06a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:02.940422 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-42d23494-096d-46a5-9cbd-ab7a3035d06a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:02.940422 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-42d23494-096d-46a5-9cbd-ab7a3035d06a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:02.940422 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-42d23494-096d-46a5-9cbd-ab7a3035d06a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:02.962031 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-42d23494-096d-46a5-9cbd-ab7a3035d06a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lazy-loading 'flavor' on Instance uuid 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:24:03.124300 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-71dd75d4-206a-405d-b4a0-33cf40a3eb11 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:03.124971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-71dd75d4-206a-405d-b4a0-33cf40a3eb11 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:03.131406 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-71dd75d4-206a-405d-b4a0-33cf40a3eb11 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:03.131855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-71dd75d4-206a-405d-b4a0-33cf40a3eb11 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:03.132626 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-71dd75d4-206a-405d-b4a0-33cf40a3eb11 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:03.133084 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-71dd75d4-206a-405d-b4a0-33cf40a3eb11 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:03.273352 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-71dd75d4-206a-405d-b4a0-33cf40a3eb11 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:03.282202 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-71dd75d4-206a-405d-b4a0-33cf40a3eb11 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:03.284130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-71dd75d4-206a-405d-b4a0-33cf40a3eb11 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:03.285665 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-71dd75d4-206a-405d-b4a0-33cf40a3eb11 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.164843 Jun 22 10:24:03.286430 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 338/674] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:24:03 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:24:03.376978 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-9423a1f1-3d6a-4aa9-8402-d2fefbeeac45 req-911e0462-767e-4ad6-b236-231dec8b9d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fa8c96-e39d-47ce-86a0-9d7d7eaf099f", "name": "network-vif-plugged", "status": "completed", "tag": "9c2ee9e8-f445-4686-bacb-0cbc5c3c71de"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:03.385639 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-9423a1f1-3d6a-4aa9-8402-d2fefbeeac45 req-911e0462-767e-4ad6-b236-231dec8b9d28 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:03.389409 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-9423a1f1-3d6a-4aa9-8402-d2fefbeeac45 req-911e0462-767e-4ad6-b236-231dec8b9d28 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:03.397464 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-9423a1f1-3d6a-4aa9-8402-d2fefbeeac45 req-911e0462-767e-4ad6-b236-231dec8b9d28 service nova] Creating event network-vif-plugged:9c2ee9e8-f445-4686-bacb-0cbc5c3c71de for instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f on hv-cinder-84327 Jun 22 10:24:03.402631 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-9423a1f1-3d6a-4aa9-8402-d2fefbeeac45 req-911e0462-767e-4ad6-b236-231dec8b9d28 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029364 Jun 22 10:24:03.403247 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 339/675] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:24:03.548401 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-42d23494-096d-46a5-9cbd-ab7a3035d06a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "POST /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/action" status: 200 len: 32 microversion: 2.1 time: 0.624598 Jun 22 10:24:03.549159 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 337/676] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:24:02 2022] POST /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/action => generated 32 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:24:03.558868 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9bf04760-0346-478c-acd6-e0a12d491d4a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:03.559540 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9bf04760-0346-478c-acd6-e0a12d491d4a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:03.566766 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9bf04760-0346-478c-acd6-e0a12d491d4a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:03.567277 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9bf04760-0346-478c-acd6-e0a12d491d4a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:03.568183 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9bf04760-0346-478c-acd6-e0a12d491d4a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:03.569207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9bf04760-0346-478c-acd6-e0a12d491d4a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:03.703191 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9bf04760-0346-478c-acd6-e0a12d491d4a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:03.712392 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9bf04760-0346-478c-acd6-e0a12d491d4a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.157803 Jun 22 10:24:03.712995 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 340/677] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:03 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:24:04.306359 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-017bae8f-7780-4fe5-80b0-2d52602a5b39 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:04.307184 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-017bae8f-7780-4fe5-80b0-2d52602a5b39 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:04.313406 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-017bae8f-7780-4fe5-80b0-2d52602a5b39 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:04.313861 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-017bae8f-7780-4fe5-80b0-2d52602a5b39 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:04.314635 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-017bae8f-7780-4fe5-80b0-2d52602a5b39 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:04.315073 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-017bae8f-7780-4fe5-80b0-2d52602a5b39 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:04.447841 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-017bae8f-7780-4fe5-80b0-2d52602a5b39 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:04.456334 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-017bae8f-7780-4fe5-80b0-2d52602a5b39 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:04.457877 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-017bae8f-7780-4fe5-80b0-2d52602a5b39 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:04.459056 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-017bae8f-7780-4fe5-80b0-2d52602a5b39 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.158100 Jun 22 10:24:04.459609 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 338/678] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:24:04 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:24:04.730240 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-38730024-2ea6-408c-be03-207c9685ef0d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:04.730836 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-38730024-2ea6-408c-be03-207c9685ef0d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:04.737402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38730024-2ea6-408c-be03-207c9685ef0d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:04.737853 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38730024-2ea6-408c-be03-207c9685ef0d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:04.738620 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38730024-2ea6-408c-be03-207c9685ef0d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:04.739056 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38730024-2ea6-408c-be03-207c9685ef0d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:04.868879 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-38730024-2ea6-408c-be03-207c9685ef0d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:04.876651 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-38730024-2ea6-408c-be03-207c9685ef0d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.150333 Jun 22 10:24:04.877234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 341/679] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:04 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:05.477544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c346d089-c8a2-45d7-8d0a-55342f4958c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:05.478151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c346d089-c8a2-45d7-8d0a-55342f4958c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:05.484701 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c346d089-c8a2-45d7-8d0a-55342f4958c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:05.485187 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c346d089-c8a2-45d7-8d0a-55342f4958c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:05.485942 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c346d089-c8a2-45d7-8d0a-55342f4958c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:05.486376 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c346d089-c8a2-45d7-8d0a-55342f4958c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:05.613801 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c346d089-c8a2-45d7-8d0a-55342f4958c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:05.622670 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c346d089-c8a2-45d7-8d0a-55342f4958c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:05.624162 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c346d089-c8a2-45d7-8d0a-55342f4958c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:05.625350 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c346d089-c8a2-45d7-8d0a-55342f4958c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.151871 Jun 22 10:24:05.625908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 339/680] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:24:05 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:24:05.894484 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ac0d47c9-4d99-4ddd-8645-55fbe525d4a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:05.895319 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ac0d47c9-4d99-4ddd-8645-55fbe525d4a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:05.902817 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ac0d47c9-4d99-4ddd-8645-55fbe525d4a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:05.903186 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ac0d47c9-4d99-4ddd-8645-55fbe525d4a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:05.903958 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ac0d47c9-4d99-4ddd-8645-55fbe525d4a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:05.904386 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ac0d47c9-4d99-4ddd-8645-55fbe525d4a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:06.046228 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ac0d47c9-4d99-4ddd-8645-55fbe525d4a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:06.054455 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ac0d47c9-4d99-4ddd-8645-55fbe525d4a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.163900 Jun 22 10:24:06.055373 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 342/681] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:05 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:06.643458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-828c39a5-063e-402f-baa3-f6aa839bcbd7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:06.644074 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-828c39a5-063e-402f-baa3-f6aa839bcbd7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:06.651375 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-828c39a5-063e-402f-baa3-f6aa839bcbd7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:06.651827 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-828c39a5-063e-402f-baa3-f6aa839bcbd7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:06.652604 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-828c39a5-063e-402f-baa3-f6aa839bcbd7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:06.653160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-828c39a5-063e-402f-baa3-f6aa839bcbd7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:06.813838 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-828c39a5-063e-402f-baa3-f6aa839bcbd7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:06.822868 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-828c39a5-063e-402f-baa3-f6aa839bcbd7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:06.824364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-828c39a5-063e-402f-baa3-f6aa839bcbd7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:06.825545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-828c39a5-063e-402f-baa3-f6aa839bcbd7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1810 microversion: 2.20 time: 0.185969 Jun 22 10:24:06.826112 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 340/682] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:24:06 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:24:07.072108 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d5e40770-ddeb-45b7-b7f5-c676447cda97 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:07.072709 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d5e40770-ddeb-45b7-b7f5-c676447cda97 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:07.074814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:07.080029 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d5e40770-ddeb-45b7-b7f5-c676447cda97 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:07.080479 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d5e40770-ddeb-45b7-b7f5-c676447cda97 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:07.081271 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d5e40770-ddeb-45b7-b7f5-c676447cda97 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:07.081708 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d5e40770-ddeb-45b7-b7f5-c676447cda97 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:07.219094 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d5e40770-ddeb-45b7-b7f5-c676447cda97 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:07.227726 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d5e40770-ddeb-45b7-b7f5-c676447cda97 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.159962 Jun 22 10:24:07.228310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 343/683] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:07 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:07.843412 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d7d46b4a-f771-4265-9ce8-bc5259b71c60 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:07.844012 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d7d46b4a-f771-4265-9ce8-bc5259b71c60 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:07.850747 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d7d46b4a-f771-4265-9ce8-bc5259b71c60 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:07.851237 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d7d46b4a-f771-4265-9ce8-bc5259b71c60 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:07.851985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d7d46b4a-f771-4265-9ce8-bc5259b71c60 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:07.852950 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d7d46b4a-f771-4265-9ce8-bc5259b71c60 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:07.983107 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d7d46b4a-f771-4265-9ce8-bc5259b71c60 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:07.991622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d7d46b4a-f771-4265-9ce8-bc5259b71c60 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:07.993174 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d7d46b4a-f771-4265-9ce8-bc5259b71c60 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:07.994324 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d7d46b4a-f771-4265-9ce8-bc5259b71c60 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1797 microversion: 2.20 time: 0.154811 Jun 22 10:24:07.994875 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 341/684] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:24:07 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1797 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:24:08.245219 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3690a2b4-c6be-4be4-be71-190aef0ca007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:08.245773 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3690a2b4-c6be-4be4-be71-190aef0ca007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:08.252416 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3690a2b4-c6be-4be4-be71-190aef0ca007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:08.252913 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3690a2b4-c6be-4be4-be71-190aef0ca007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:08.253686 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3690a2b4-c6be-4be4-be71-190aef0ca007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:08.254129 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3690a2b4-c6be-4be4-be71-190aef0ca007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:08.397495 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3690a2b4-c6be-4be4-be71-190aef0ca007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:08.405577 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3690a2b4-c6be-4be4-be71-190aef0ca007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.164350 Jun 22 10:24:08.406141 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 344/685] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:08 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:09.422977 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9c537eb0-f3a4-4177-87f4-df7906f2ab85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:09.423588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9c537eb0-f3a4-4177-87f4-df7906f2ab85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:09.430677 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9c537eb0-f3a4-4177-87f4-df7906f2ab85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:09.431128 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9c537eb0-f3a4-4177-87f4-df7906f2ab85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:09.431891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9c537eb0-f3a4-4177-87f4-df7906f2ab85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:09.432345 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9c537eb0-f3a4-4177-87f4-df7906f2ab85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:09.557332 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9c537eb0-f3a4-4177-87f4-df7906f2ab85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:09.566472 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9c537eb0-f3a4-4177-87f4-df7906f2ab85 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.147352 Jun 22 10:24:09.567052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 342/686] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:09 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:10.583209 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6f939f98-17fd-4403-aef7-c8a49080e916 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:10.584037 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6f939f98-17fd-4403-aef7-c8a49080e916 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:10.590855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6f939f98-17fd-4403-aef7-c8a49080e916 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:10.591307 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6f939f98-17fd-4403-aef7-c8a49080e916 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:10.592085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6f939f98-17fd-4403-aef7-c8a49080e916 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:10.592565 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6f939f98-17fd-4403-aef7-c8a49080e916 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:10.723863 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6f939f98-17fd-4403-aef7-c8a49080e916 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:10.732020 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6f939f98-17fd-4403-aef7-c8a49080e916 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.152974 Jun 22 10:24:10.732587 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 345/687] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:10 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:11.074110 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-623a6ddc-e87b-4ef6-a1d5-e0f544b723d4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:11.074745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-623a6ddc-e87b-4ef6-a1d5-e0f544b723d4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:11.081193 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-623a6ddc-e87b-4ef6-a1d5-e0f544b723d4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:11.081639 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-623a6ddc-e87b-4ef6-a1d5-e0f544b723d4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:11.082393 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-623a6ddc-e87b-4ef6-a1d5-e0f544b723d4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:11.082831 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-623a6ddc-e87b-4ef6-a1d5-e0f544b723d4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:11.215449 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-623a6ddc-e87b-4ef6-a1d5-e0f544b723d4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:11.223564 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-623a6ddc-e87b-4ef6-a1d5-e0f544b723d4 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1594 microversion: 2.1 time: 0.153204 Jun 22 10:24:11.224132 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 343/688] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:11 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:11.750617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-049e21ef-c53a-4f44-a469-75b686e6d992 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:11.751374 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-049e21ef-c53a-4f44-a469-75b686e6d992 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:11.758255 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-049e21ef-c53a-4f44-a469-75b686e6d992 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:11.758706 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-049e21ef-c53a-4f44-a469-75b686e6d992 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:11.759481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-049e21ef-c53a-4f44-a469-75b686e6d992 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:11.759925 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-049e21ef-c53a-4f44-a469-75b686e6d992 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:11.886752 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-049e21ef-c53a-4f44-a469-75b686e6d992 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:11.894681 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-049e21ef-c53a-4f44-a469-75b686e6d992 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.148171 Jun 22 10:24:11.895252 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 346/689] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:11 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:12.913201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fb43d998-f43a-4444-8e2b-1240e6b72653 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:12.913738 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-fb43d998-f43a-4444-8e2b-1240e6b72653 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:12.920341 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fb43d998-f43a-4444-8e2b-1240e6b72653 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:12.920796 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fb43d998-f43a-4444-8e2b-1240e6b72653 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:12.921602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fb43d998-f43a-4444-8e2b-1240e6b72653 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:12.922046 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fb43d998-f43a-4444-8e2b-1240e6b72653 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:13.056568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-fb43d998-f43a-4444-8e2b-1240e6b72653 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:13.065924 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-fb43d998-f43a-4444-8e2b-1240e6b72653 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.157518 Jun 22 10:24:13.066499 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 344/690] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:12 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:13.539298 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-89fa2cc1-54d5-4e75-b633-8a92bd2c0522 req-3d1ed6b1-e361-4ae3-a243-617d8f616d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4e73d9-0607-4ae9-8fb5-30bd61f928f1", "tag": "249b9885-08e1-4d0f-8a26-3a03a7f683a3"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:13.548332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-89fa2cc1-54d5-4e75-b633-8a92bd2c0522 req-3d1ed6b1-e361-4ae3-a243-617d8f616d0a service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:13.548692 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-89fa2cc1-54d5-4e75-b633-8a92bd2c0522 req-3d1ed6b1-e361-4ae3-a243-617d8f616d0a service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:13.562590 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-89fa2cc1-54d5-4e75-b633-8a92bd2c0522 req-3d1ed6b1-e361-4ae3-a243-617d8f616d0a service nova] Creating event network-changed:249b9885-08e1-4d0f-8a26-3a03a7f683a3 for instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 on hv-cinder-84327 Jun 22 10:24:13.567793 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-89fa2cc1-54d5-4e75-b633-8a92bd2c0522 req-3d1ed6b1-e361-4ae3-a243-617d8f616d0a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032655 Jun 22 10:24:13.568674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 347/691] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:24:14.082982 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-af32827d-11fe-482f-b57e-cef7b11875d1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:14.084267 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-af32827d-11fe-482f-b57e-cef7b11875d1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:14.090914 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-af32827d-11fe-482f-b57e-cef7b11875d1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:14.091362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-af32827d-11fe-482f-b57e-cef7b11875d1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:14.092136 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-af32827d-11fe-482f-b57e-cef7b11875d1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:14.092567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-af32827d-11fe-482f-b57e-cef7b11875d1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:14.241569 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-af32827d-11fe-482f-b57e-cef7b11875d1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:14.253872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-af32827d-11fe-482f-b57e-cef7b11875d1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.174563 Jun 22 10:24:14.254988 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 345/692] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:14 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:15.273234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f4e7a23f-8666-49b1-86fc-caf91bfc6fc6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:15.274139 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f4e7a23f-8666-49b1-86fc-caf91bfc6fc6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:15.281347 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f4e7a23f-8666-49b1-86fc-caf91bfc6fc6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:15.281874 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f4e7a23f-8666-49b1-86fc-caf91bfc6fc6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:15.282941 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f4e7a23f-8666-49b1-86fc-caf91bfc6fc6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:15.283380 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f4e7a23f-8666-49b1-86fc-caf91bfc6fc6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:15.426425 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f4e7a23f-8666-49b1-86fc-caf91bfc6fc6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:15.435061 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f4e7a23f-8666-49b1-86fc-caf91bfc6fc6 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.167705 Jun 22 10:24:15.435627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 348/693] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:15 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:16.046498 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-39646cbb-40e7-4d4c-9b1b-ef81e200737e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1495144866"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:16.047003 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-39646cbb-40e7-4d4c-9b1b-ef81e200737e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:16.053784 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-39646cbb-40e7-4d4c-9b1b-ef81e200737e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:16.054235 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-39646cbb-40e7-4d4c-9b1b-ef81e200737e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:16.054992 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-39646cbb-40e7-4d4c-9b1b-ef81e200737e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:16.055425 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-39646cbb-40e7-4d4c-9b1b-ef81e200737e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:16.184154 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.network.security_group_api [None req-39646cbb-40e7-4d4c-9b1b-ef81e200737e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Adding security group 103c4e89-8f20-431c-b1f1-ad4849ba88e0 to port 249b9885-08e1-4d0f-8a26-3a03a7f683a3 Jun 22 10:24:16.451795 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7f95a35b-d809-4920-b4da-c32bdceb67a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:16.452331 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7f95a35b-d809-4920-b4da-c32bdceb67a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:16.458970 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7f95a35b-d809-4920-b4da-c32bdceb67a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:16.460036 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7f95a35b-d809-4920-b4da-c32bdceb67a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:16.460809 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7f95a35b-d809-4920-b4da-c32bdceb67a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:16.461298 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7f95a35b-d809-4920-b4da-c32bdceb67a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:16.612412 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7f95a35b-d809-4920-b4da-c32bdceb67a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:16.621113 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7f95a35b-d809-4920-b4da-c32bdceb67a1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.173187 Jun 22 10:24:16.621681 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 349/694] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:16 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:24:16.683810 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-39646cbb-40e7-4d4c-9b1b-ef81e200737e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "POST /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/action" status: 202 len: 0 microversion: 2.1 time: 0.641087 Jun 22 10:24:16.685121 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 346/695] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:24:16 2022] POST /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/action => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:24:16.704127 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a6ddbe9c-1e3e-4722-9a6a-8ab60c1a3cbf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:16.704666 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a6ddbe9c-1e3e-4722-9a6a-8ab60c1a3cbf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:16.717797 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a6ddbe9c-1e3e-4722-9a6a-8ab60c1a3cbf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:16.738615 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a6ddbe9c-1e3e-4722-9a6a-8ab60c1a3cbf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:16.738615 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a6ddbe9c-1e3e-4722-9a6a-8ab60c1a3cbf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:16.738615 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a6ddbe9c-1e3e-4722-9a6a-8ab60c1a3cbf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:16.775719 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-8fabb23f-7258-453d-8663-b56f5358c306 req-453b1f80-8d90-4480-bea3-c781899e0849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4e73d9-0607-4ae9-8fb5-30bd61f928f1", "tag": "249b9885-08e1-4d0f-8a26-3a03a7f683a3"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:16.784337 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-8fabb23f-7258-453d-8663-b56f5358c306 req-453b1f80-8d90-4480-bea3-c781899e0849 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:16.785096 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-8fabb23f-7258-453d-8663-b56f5358c306 req-453b1f80-8d90-4480-bea3-c781899e0849 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:16.798685 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-8fabb23f-7258-453d-8663-b56f5358c306 req-453b1f80-8d90-4480-bea3-c781899e0849 service nova] Creating event network-changed:249b9885-08e1-4d0f-8a26-3a03a7f683a3 for instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 on hv-cinder-84327 Jun 22 10:24:16.806062 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-8fabb23f-7258-453d-8663-b56f5358c306 req-453b1f80-8d90-4480-bea3-c781899e0849 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114980 Jun 22 10:24:16.806916 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 347/696] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:16.897706 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a6ddbe9c-1e3e-4722-9a6a-8ab60c1a3cbf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:16.907745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a6ddbe9c-1e3e-4722-9a6a-8ab60c1a3cbf tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1760 microversion: 2.1 time: 0.213636 Jun 22 10:24:16.913643 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 350/697] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:16 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1760 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:17.639503 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0d1314ed-6932-4081-8b90-576352932089 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:17.640330 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0d1314ed-6932-4081-8b90-576352932089 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:17.646518 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0d1314ed-6932-4081-8b90-576352932089 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:17.647071 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0d1314ed-6932-4081-8b90-576352932089 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:17.647839 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0d1314ed-6932-4081-8b90-576352932089 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:17.648271 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0d1314ed-6932-4081-8b90-576352932089 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:17.784894 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0d1314ed-6932-4081-8b90-576352932089 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:17.796767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0d1314ed-6932-4081-8b90-576352932089 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.161799 Jun 22 10:24:17.797629 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 348/698] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:17 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:18.815473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1ee30141-8f6b-4d1d-be10-af37f186c3e8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:18.816088 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1ee30141-8f6b-4d1d-be10-af37f186c3e8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:18.822874 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1ee30141-8f6b-4d1d-be10-af37f186c3e8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:18.823324 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1ee30141-8f6b-4d1d-be10-af37f186c3e8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:18.824090 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1ee30141-8f6b-4d1d-be10-af37f186c3e8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:18.824528 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1ee30141-8f6b-4d1d-be10-af37f186c3e8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:18.951534 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1ee30141-8f6b-4d1d-be10-af37f186c3e8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:18.955102 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:18.959858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1ee30141-8f6b-4d1d-be10-af37f186c3e8 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.148452 Jun 22 10:24:18.960413 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 351/699] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:18 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:24:19.452316 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d66afd5f-9323-4c79-ae39-7045906dfe0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:19.452810 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d66afd5f-9323-4c79-ae39-7045906dfe0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:19.454742 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=56 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:19.459480 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d66afd5f-9323-4c79-ae39-7045906dfe0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:19.459952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d66afd5f-9323-4c79-ae39-7045906dfe0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:19.460718 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d66afd5f-9323-4c79-ae39-7045906dfe0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:19.461172 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d66afd5f-9323-4c79-ae39-7045906dfe0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:19.582654 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-d66afd5f-9323-4c79-ae39-7045906dfe0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lazy-loading 'services' on Instance uuid a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:24:19.977459 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-14057f6a-a26a-4a86-88b8-0d8f32a1d7ef tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:19.977995 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-14057f6a-a26a-4a86-88b8-0d8f32a1d7ef tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:19.983875 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d66afd5f-9323-4c79-ae39-7045906dfe0b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/os-volume_attachments/91b35dc5-ff09-4dce-8df2-3cd7d9914e8f" status: 202 len: 0 microversion: 2.1 time: 0.635885 Jun 22 10:24:19.984425 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 349/700] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jun 22 10:24:19 2022] DELETE /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/os-volume_attachments/91b35dc5-ff09-4dce-8df2-3cd7d9914e8f => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:24:19.985163 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-14057f6a-a26a-4a86-88b8-0d8f32a1d7ef tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:19.985631 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-14057f6a-a26a-4a86-88b8-0d8f32a1d7ef tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:19.986414 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-14057f6a-a26a-4a86-88b8-0d8f32a1d7ef tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:19.986852 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-14057f6a-a26a-4a86-88b8-0d8f32a1d7ef tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:20.122650 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-14057f6a-a26a-4a86-88b8-0d8f32a1d7ef tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:20.125491 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-14057f6a-a26a-4a86-88b8-0d8f32a1d7ef tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.152136 Jun 22 10:24:20.126059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 352/701] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:19 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:24:21.144009 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f7882cbc-eb03-49c9-ad73-8ef68d71f7fb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:21.144731 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f7882cbc-eb03-49c9-ad73-8ef68d71f7fb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:21.150989 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f7882cbc-eb03-49c9-ad73-8ef68d71f7fb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:21.154724 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f7882cbc-eb03-49c9-ad73-8ef68d71f7fb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:21.154724 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f7882cbc-eb03-49c9-ad73-8ef68d71f7fb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:21.154724 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f7882cbc-eb03-49c9-ad73-8ef68d71f7fb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:21.288035 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f7882cbc-eb03-49c9-ad73-8ef68d71f7fb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:21.296352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f7882cbc-eb03-49c9-ad73-8ef68d71f7fb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.157043 Jun 22 10:24:21.296952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 350/702] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:21 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:22.154671 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-fc7760f1-89e0-4e37-83f8-f77026db9efb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:22.161543 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fc7760f1-89e0-4e37-83f8-f77026db9efb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:22.161991 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fc7760f1-89e0-4e37-83f8-f77026db9efb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:22.220052 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-fc7760f1-89e0-4e37-83f8-f77026db9efb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Going to try to stop instance {{(pid=118326) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 10:24:22.316708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ddc5ac5e-d68d-4920-95de-e403d791a904 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:22.317354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ddc5ac5e-d68d-4920-95de-e403d791a904 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:22.324544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ddc5ac5e-d68d-4920-95de-e403d791a904 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:22.325035 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ddc5ac5e-d68d-4920-95de-e403d791a904 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:22.325801 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ddc5ac5e-d68d-4920-95de-e403d791a904 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:22.326255 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ddc5ac5e-d68d-4920-95de-e403d791a904 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:22.456008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ddc5ac5e-d68d-4920-95de-e403d791a904 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:22.459607 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:22.465171 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ddc5ac5e-d68d-4920-95de-e403d791a904 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.152408 Jun 22 10:24:22.465783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 351/703] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:22 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:24:22.609867 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-fc7760f1-89e0-4e37-83f8-f77026db9efb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "POST /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/action" status: 202 len: 0 microversion: 2.1 time: 0.458813 Jun 22 10:24:22.610469 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 353/704] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:24:22 2022] POST /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:24:22.619303 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-265e207c-ab81-4d37-93e5-ce4c3128bad7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:22.620101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-265e207c-ab81-4d37-93e5-ce4c3128bad7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:22.626818 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-265e207c-ab81-4d37-93e5-ce4c3128bad7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:22.627282 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-265e207c-ab81-4d37-93e5-ce4c3128bad7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:22.628077 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-265e207c-ab81-4d37-93e5-ce4c3128bad7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:22.628525 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-265e207c-ab81-4d37-93e5-ce4c3128bad7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:22.767030 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-265e207c-ab81-4d37-93e5-ce4c3128bad7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:22.775065 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-265e207c-ab81-4d37-93e5-ce4c3128bad7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.160093 Jun 22 10:24:22.775662 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 352/705] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:22 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:23.484793 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-20da334c-5efb-477f-a629-9da451db3bd7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:23.485541 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-20da334c-5efb-477f-a629-9da451db3bd7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:23.491781 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-20da334c-5efb-477f-a629-9da451db3bd7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:23.492235 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-20da334c-5efb-477f-a629-9da451db3bd7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:23.493039 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-20da334c-5efb-477f-a629-9da451db3bd7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:23.493512 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-20da334c-5efb-477f-a629-9da451db3bd7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:23.625423 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-20da334c-5efb-477f-a629-9da451db3bd7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:23.634178 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-20da334c-5efb-477f-a629-9da451db3bd7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.154521 Jun 22 10:24:23.634752 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 354/706] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:23 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:23.792743 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b07dac87-a775-4f9f-b12f-3863b3eddff7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:23.793411 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b07dac87-a775-4f9f-b12f-3863b3eddff7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:23.800758 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b07dac87-a775-4f9f-b12f-3863b3eddff7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:23.801323 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b07dac87-a775-4f9f-b12f-3863b3eddff7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:23.802095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b07dac87-a775-4f9f-b12f-3863b3eddff7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:23.802539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b07dac87-a775-4f9f-b12f-3863b3eddff7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:23.940131 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b07dac87-a775-4f9f-b12f-3863b3eddff7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:23.948112 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b07dac87-a775-4f9f-b12f-3863b3eddff7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.159480 Jun 22 10:24:23.948688 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 353/707] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:23 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:24.651179 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-109253df-5326-4fe1-b49c-e23e52a8d1ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:24.651785 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-109253df-5326-4fe1-b49c-e23e52a8d1ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:24.658230 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-109253df-5326-4fe1-b49c-e23e52a8d1ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:24.658685 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-109253df-5326-4fe1-b49c-e23e52a8d1ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:24.659444 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-109253df-5326-4fe1-b49c-e23e52a8d1ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:24.659881 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-109253df-5326-4fe1-b49c-e23e52a8d1ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:24.791460 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-109253df-5326-4fe1-b49c-e23e52a8d1ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:24.799428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-109253df-5326-4fe1-b49c-e23e52a8d1ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.152136 Jun 22 10:24:24.800005 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 355/708] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:24 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:24.965338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8395a2bc-7be3-4153-ab40-d11c3e1bedab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:24.965869 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8395a2bc-7be3-4153-ab40-d11c3e1bedab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:24.972291 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8395a2bc-7be3-4153-ab40-d11c3e1bedab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:24.972725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8395a2bc-7be3-4153-ab40-d11c3e1bedab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:24.973523 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8395a2bc-7be3-4153-ab40-d11c3e1bedab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:24.973952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8395a2bc-7be3-4153-ab40-d11c3e1bedab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:25.105585 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8395a2bc-7be3-4153-ab40-d11c3e1bedab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:25.113261 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-8395a2bc-7be3-4153-ab40-d11c3e1bedab tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.151859 Jun 22 10:24:25.113893 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 354/709] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:24 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:25.816784 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-340b860e-5d02-47f8-bf0d-1900b5f2c7ba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:25.817427 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-340b860e-5d02-47f8-bf0d-1900b5f2c7ba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:25.820492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=50 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:25.825718 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-340b860e-5d02-47f8-bf0d-1900b5f2c7ba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:25.826160 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-340b860e-5d02-47f8-bf0d-1900b5f2c7ba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:25.826921 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-340b860e-5d02-47f8-bf0d-1900b5f2c7ba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:25.827351 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-340b860e-5d02-47f8-bf0d-1900b5f2c7ba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:25.960720 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-340b860e-5d02-47f8-bf0d-1900b5f2c7ba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:25.968617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-340b860e-5d02-47f8-bf0d-1900b5f2c7ba tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.155995 Jun 22 10:24:25.969214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 356/710] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:25 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:26.130608 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-21986446-31e0-4b5b-89da-977ffbe80b9d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:26.131154 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-21986446-31e0-4b5b-89da-977ffbe80b9d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:26.137749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-21986446-31e0-4b5b-89da-977ffbe80b9d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:26.138204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-21986446-31e0-4b5b-89da-977ffbe80b9d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:26.138980 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-21986446-31e0-4b5b-89da-977ffbe80b9d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:26.139412 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-21986446-31e0-4b5b-89da-977ffbe80b9d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:26.265483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-21986446-31e0-4b5b-89da-977ffbe80b9d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:26.273390 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-21986446-31e0-4b5b-89da-977ffbe80b9d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.146234 Jun 22 10:24:26.274034 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 355/711] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:26 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:26.986263 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9b489498-915e-4b1c-b776-c41e89f620bc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:26.986794 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9b489498-915e-4b1c-b776-c41e89f620bc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:26.993831 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b489498-915e-4b1c-b776-c41e89f620bc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:26.994284 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b489498-915e-4b1c-b776-c41e89f620bc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:26.995053 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b489498-915e-4b1c-b776-c41e89f620bc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:26.995493 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b489498-915e-4b1c-b776-c41e89f620bc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:27.125724 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9b489498-915e-4b1c-b776-c41e89f620bc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:27.134487 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9b489498-915e-4b1c-b776-c41e89f620bc tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.152144 Jun 22 10:24:27.135058 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 357/712] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:26 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:27.290726 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3f838a37-bd17-4a2f-b533-74c93c46804b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:27.295293 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3f838a37-bd17-4a2f-b533-74c93c46804b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:27.298196 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3f838a37-bd17-4a2f-b533-74c93c46804b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:27.298648 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3f838a37-bd17-4a2f-b533-74c93c46804b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:27.299418 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3f838a37-bd17-4a2f-b533-74c93c46804b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:27.299884 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3f838a37-bd17-4a2f-b533-74c93c46804b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:27.434379 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3f838a37-bd17-4a2f-b533-74c93c46804b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:27.438037 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3f838a37-bd17-4a2f-b533-74c93c46804b tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.151471 Jun 22 10:24:27.438666 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 356/713] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:27 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:28.152394 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b16e75bd-3ca7-40c5-884c-2ff0aaee00e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:28.153050 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b16e75bd-3ca7-40c5-884c-2ff0aaee00e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:28.159539 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b16e75bd-3ca7-40c5-884c-2ff0aaee00e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:28.159988 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b16e75bd-3ca7-40c5-884c-2ff0aaee00e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:28.161043 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b16e75bd-3ca7-40c5-884c-2ff0aaee00e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:28.161478 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b16e75bd-3ca7-40c5-884c-2ff0aaee00e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:28.288080 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b16e75bd-3ca7-40c5-884c-2ff0aaee00e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:28.296004 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b16e75bd-3ca7-40c5-884c-2ff0aaee00e1 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.148213 Jun 22 10:24:28.296562 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 358/714] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:28 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:28.455140 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c3cfd058-1c6a-4506-bf50-55dcdc645ea6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:28.455685 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c3cfd058-1c6a-4506-bf50-55dcdc645ea6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:28.462862 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c3cfd058-1c6a-4506-bf50-55dcdc645ea6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:28.463314 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c3cfd058-1c6a-4506-bf50-55dcdc645ea6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:28.464070 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c3cfd058-1c6a-4506-bf50-55dcdc645ea6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:28.464508 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c3cfd058-1c6a-4506-bf50-55dcdc645ea6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:28.594029 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c3cfd058-1c6a-4506-bf50-55dcdc645ea6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:28.602025 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c3cfd058-1c6a-4506-bf50-55dcdc645ea6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.150824 Jun 22 10:24:28.602607 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 357/715] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:28 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:29.313107 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-fd56e902-cf9f-4d95-a4e2-433f994476ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:29.317661 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-fd56e902-cf9f-4d95-a4e2-433f994476ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:29.320920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fd56e902-cf9f-4d95-a4e2-433f994476ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:29.321416 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fd56e902-cf9f-4d95-a4e2-433f994476ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:29.322178 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fd56e902-cf9f-4d95-a4e2-433f994476ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:29.322618 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fd56e902-cf9f-4d95-a4e2-433f994476ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:29.452662 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-fd56e902-cf9f-4d95-a4e2-433f994476ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:29.460989 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-fd56e902-cf9f-4d95-a4e2-433f994476ec tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1735 microversion: 2.1 time: 0.151695 Jun 22 10:24:29.461779 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 359/716] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:29 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:29.619015 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c2c654ef-53a9-495a-9d1b-d52edc496a38 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:29.619550 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c2c654ef-53a9-495a-9d1b-d52edc496a38 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:29.626314 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c2c654ef-53a9-495a-9d1b-d52edc496a38 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:29.630259 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c2c654ef-53a9-495a-9d1b-d52edc496a38 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:29.630259 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c2c654ef-53a9-495a-9d1b-d52edc496a38 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:29.630259 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c2c654ef-53a9-495a-9d1b-d52edc496a38 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:29.760545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c2c654ef-53a9-495a-9d1b-d52edc496a38 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:29.768130 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c2c654ef-53a9-495a-9d1b-d52edc496a38 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.153811 Jun 22 10:24:29.768700 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 358/717] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:29 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:30.478442 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8cf5a3d9-ebdd-4dde-991b-76b58a7d273d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:30.494207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8cf5a3d9-ebdd-4dde-991b-76b58a7d273d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:30.494207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8cf5a3d9-ebdd-4dde-991b-76b58a7d273d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:30.494207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8cf5a3d9-ebdd-4dde-991b-76b58a7d273d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:30.494207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8cf5a3d9-ebdd-4dde-991b-76b58a7d273d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:30.494659 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8cf5a3d9-ebdd-4dde-991b-76b58a7d273d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:30.616434 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8cf5a3d9-ebdd-4dde-991b-76b58a7d273d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:30.625086 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8cf5a3d9-ebdd-4dde-991b-76b58a7d273d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1715 microversion: 2.1 time: 0.151015 Jun 22 10:24:30.632113 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 360/718] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:30 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:30.686460 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-afa1d53f-2afb-46e9-b7f1-c1aab5e8582b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:30.686981 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-afa1d53f-2afb-46e9-b7f1-c1aab5e8582b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:30.693542 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-afa1d53f-2afb-46e9-b7f1-c1aab5e8582b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:30.693997 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-afa1d53f-2afb-46e9-b7f1-c1aab5e8582b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:30.694762 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-afa1d53f-2afb-46e9-b7f1-c1aab5e8582b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:30.695196 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-afa1d53f-2afb-46e9-b7f1-c1aab5e8582b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:30.775997 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-afa1d53f-2afb-46e9-b7f1-c1aab5e8582b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] HTTP exception thrown: Cannot 'detach_volume' instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 while it is in vm_state rescued Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-afa1d53f-2afb-46e9-b7f1-c1aab5e8582b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Request method failure captured: Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: DELETE /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments/27521dce-bad8-4675-9f87-2190bd984c2c HTTP/1.1 Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisux0IeVehkqtNo7n7J7FM8HPVJHOjCuT4m0Ji2aSNkBVMCCn6SbSuTDB7CSpzKBIHPL8itk1MLGK3PBVVED-wqW1XGpxjrpnMahJuE-_foiUHqCo7_rUnQn9l6VFl_80qm7MInXFrtEQmwRBBty2huD9MJbF9_iRgsagV3uAZLCm1iA Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 30df978aece349c4baf14cc311f7b498 Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:24:30.777676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:24:30.779268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30df978aece349c4baf14cc311f7b498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_30df978aece349c4baf14cc311f7b498", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30df978aece349c4baf14cc311f7b498"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/30df978aece349c4baf14cc311f7b498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:24:30.779268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:24:30.779268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 30df978aece349c4baf14cc311f7b498 Jun 22 10:24:30.779268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:24:30.779268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-ServerRescueNegativeTestJSON-190891196-project Jun 22 10:24:30.779268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:24:30.779268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:24:30.779268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 425bf40bd45642a1aafeb65bdb9650af Jun 22 10:24:30.779268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-ServerRescueNegativeTestJSON-190891196-project Jun 22 10:24:30.779268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:24:30.779268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Cannot 'detach_volume' instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 while it is in vm_state rescued Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'server_id': '4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6', 'id': '27521dce-bad8-4675-9f87-2190bd984c2c'} Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:24:30.780045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 while it is in vm_state rescued Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 while it is in vm_state rescued Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:24:30.781589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-afa1d53f-2afb-46e9-b7f1-c1aab5e8582b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Returning 409 to user: Cannot 'detach_volume' instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 while it is in vm_state rescued {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:24:30.782775 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-afa1d53f-2afb-46e9-b7f1-c1aab5e8582b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments/27521dce-bad8-4675-9f87-2190bd984c2c" status: 409 len: 152 microversion: 2.1 time: 0.096765 Jun 22 10:24:30.782775 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 359/719] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jun 22 10:24:30 2022] DELETE /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments/27521dce-bad8-4675-9f87-2190bd984c2c => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 10:24:30.788001 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-47ca9f30-754b-41e6-8be2-3c28ab31506e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:30.788184 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0a974f53-1cde-4e13-80c7-334a0997119a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:30.788529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-47ca9f30-754b-41e6-8be2-3c28ab31506e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:30.788741 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0a974f53-1cde-4e13-80c7-334a0997119a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:30.795430 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0a974f53-1cde-4e13-80c7-334a0997119a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:30.795882 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0a974f53-1cde-4e13-80c7-334a0997119a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:30.796424 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-47ca9f30-754b-41e6-8be2-3c28ab31506e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:30.796662 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0a974f53-1cde-4e13-80c7-334a0997119a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:30.796919 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-47ca9f30-754b-41e6-8be2-3c28ab31506e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:30.797142 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0a974f53-1cde-4e13-80c7-334a0997119a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:30.797665 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-47ca9f30-754b-41e6-8be2-3c28ab31506e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:30.798100 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-47ca9f30-754b-41e6-8be2-3c28ab31506e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:30.939921 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0a974f53-1cde-4e13-80c7-334a0997119a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:30.948943 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0a974f53-1cde-4e13-80c7-334a0997119a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.164094 Jun 22 10:24:30.948943 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 361/720] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:30 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:31.109447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-47ca9f30-754b-41e6-8be2-3c28ab31506e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "POST /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/action" status: 202 len: 0 microversion: 2.1 time: 0.325049 Jun 22 10:24:31.113295 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 360/721] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:24:30 2022] POST /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:24:31.119436 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bce6a202-d49c-4efa-96fc-5e5f4288ac7a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:31.120040 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bce6a202-d49c-4efa-96fc-5e5f4288ac7a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:31.128166 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bce6a202-d49c-4efa-96fc-5e5f4288ac7a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:31.128702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bce6a202-d49c-4efa-96fc-5e5f4288ac7a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:31.129589 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bce6a202-d49c-4efa-96fc-5e5f4288ac7a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:31.130092 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bce6a202-d49c-4efa-96fc-5e5f4288ac7a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:31.504840 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bce6a202-d49c-4efa-96fc-5e5f4288ac7a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:31.517677 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bce6a202-d49c-4efa-96fc-5e5f4288ac7a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1723 microversion: 2.1 time: 0.402854 Jun 22 10:24:31.518654 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 362/722] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:31 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:31.967069 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-05eed52f-5b2b-4038-929e-f962136dba3f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:31.967669 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-05eed52f-5b2b-4038-929e-f962136dba3f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:31.973896 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-05eed52f-5b2b-4038-929e-f962136dba3f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:31.974346 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-05eed52f-5b2b-4038-929e-f962136dba3f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:31.975107 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-05eed52f-5b2b-4038-929e-f962136dba3f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:31.975545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-05eed52f-5b2b-4038-929e-f962136dba3f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:32.106509 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-05eed52f-5b2b-4038-929e-f962136dba3f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:32.114516 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-05eed52f-5b2b-4038-929e-f962136dba3f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.152695 Jun 22 10:24:32.115432 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 361/723] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:31 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:32.541833 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0f9e4c33-f329-4696-977d-c32c68953f2e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:32.542468 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0f9e4c33-f329-4696-977d-c32c68953f2e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:32.548950 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0f9e4c33-f329-4696-977d-c32c68953f2e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:32.549400 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0f9e4c33-f329-4696-977d-c32c68953f2e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:32.550162 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0f9e4c33-f329-4696-977d-c32c68953f2e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:32.550594 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0f9e4c33-f329-4696-977d-c32c68953f2e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:32.681088 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0f9e4c33-f329-4696-977d-c32c68953f2e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:32.689235 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0f9e4c33-f329-4696-977d-c32c68953f2e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1723 microversion: 2.1 time: 0.151955 Jun 22 10:24:32.689890 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 363/724] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:32 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:33.131689 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3d6259f1-8c93-4bc6-9835-d3ad393643ee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:33.132293 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3d6259f1-8c93-4bc6-9835-d3ad393643ee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:33.139454 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3d6259f1-8c93-4bc6-9835-d3ad393643ee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:33.139897 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3d6259f1-8c93-4bc6-9835-d3ad393643ee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:33.140655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3d6259f1-8c93-4bc6-9835-d3ad393643ee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:33.141117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3d6259f1-8c93-4bc6-9835-d3ad393643ee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:33.272071 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3d6259f1-8c93-4bc6-9835-d3ad393643ee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:33.279844 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3d6259f1-8c93-4bc6-9835-d3ad393643ee tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.151948 Jun 22 10:24:33.285052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 362/725] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:33 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:33.707019 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d5e867e9-498f-4562-b217-fe6d52ae0cfe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:33.707627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d5e867e9-498f-4562-b217-fe6d52ae0cfe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:33.714827 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d5e867e9-498f-4562-b217-fe6d52ae0cfe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:33.715270 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d5e867e9-498f-4562-b217-fe6d52ae0cfe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:33.716035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d5e867e9-498f-4562-b217-fe6d52ae0cfe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:33.716472 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d5e867e9-498f-4562-b217-fe6d52ae0cfe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:33.845656 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d5e867e9-498f-4562-b217-fe6d52ae0cfe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:33.853566 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d5e867e9-498f-4562-b217-fe6d52ae0cfe tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1723 microversion: 2.1 time: 0.150465 Jun 22 10:24:33.854134 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 364/726] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:33 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:34.297714 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-96234d91-d0d6-4e05-b7ad-288dff4f3e8a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:34.298318 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-96234d91-d0d6-4e05-b7ad-288dff4f3e8a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:34.304838 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-96234d91-d0d6-4e05-b7ad-288dff4f3e8a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:34.305285 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-96234d91-d0d6-4e05-b7ad-288dff4f3e8a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:34.306040 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-96234d91-d0d6-4e05-b7ad-288dff4f3e8a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:34.306474 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-96234d91-d0d6-4e05-b7ad-288dff4f3e8a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:34.433285 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-96234d91-d0d6-4e05-b7ad-288dff4f3e8a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:34.440600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-96234d91-d0d6-4e05-b7ad-288dff4f3e8a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.146724 Jun 22 10:24:34.441194 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 363/727] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:34 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:34.871474 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-de1e6f41-4b76-45f5-a570-3465d253b888 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:34.872076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-de1e6f41-4b76-45f5-a570-3465d253b888 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:34.878746 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de1e6f41-4b76-45f5-a570-3465d253b888 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:34.879198 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de1e6f41-4b76-45f5-a570-3465d253b888 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:34.879969 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de1e6f41-4b76-45f5-a570-3465d253b888 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:34.880409 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-de1e6f41-4b76-45f5-a570-3465d253b888 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:35.015464 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-de1e6f41-4b76-45f5-a570-3465d253b888 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:35.023493 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-de1e6f41-4b76-45f5-a570-3465d253b888 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1723 microversion: 2.1 time: 0.155938 Jun 22 10:24:35.024064 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 365/728] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:34 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:35.457811 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0cc169d3-3656-4a03-ab68-255c23fb1af1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:35.458488 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0cc169d3-3656-4a03-ab68-255c23fb1af1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:35.465466 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0cc169d3-3656-4a03-ab68-255c23fb1af1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:35.465921 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0cc169d3-3656-4a03-ab68-255c23fb1af1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:35.466704 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0cc169d3-3656-4a03-ab68-255c23fb1af1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:35.467144 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0cc169d3-3656-4a03-ab68-255c23fb1af1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:35.599192 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0cc169d3-3656-4a03-ab68-255c23fb1af1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:35.607487 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0cc169d3-3656-4a03-ab68-255c23fb1af1 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.153779 Jun 22 10:24:35.609243 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 364/729] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:35 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:36.041389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-48ad82a1-87be-45c5-aa43-2b76a0972eb5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:36.041989 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-48ad82a1-87be-45c5-aa43-2b76a0972eb5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:36.048499 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-48ad82a1-87be-45c5-aa43-2b76a0972eb5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:36.048986 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-48ad82a1-87be-45c5-aa43-2b76a0972eb5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:36.049756 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-48ad82a1-87be-45c5-aa43-2b76a0972eb5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:36.050193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-48ad82a1-87be-45c5-aa43-2b76a0972eb5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:36.177260 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-48ad82a1-87be-45c5-aa43-2b76a0972eb5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:36.185762 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-48ad82a1-87be-45c5-aa43-2b76a0972eb5 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1729 microversion: 2.1 time: 0.148234 Jun 22 10:24:36.186885 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 366/730] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:36 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:36.202620 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-262c0494-60b2-4416-af52-5e4a8f859605 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:36.203121 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-262c0494-60b2-4416-af52-5e4a8f859605 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:36.209634 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-262c0494-60b2-4416-af52-5e4a8f859605 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:36.210084 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-262c0494-60b2-4416-af52-5e4a8f859605 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:36.210851 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-262c0494-60b2-4416-af52-5e4a8f859605 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:36.211320 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-262c0494-60b2-4416-af52-5e4a8f859605 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:36.291443 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-262c0494-60b2-4416-af52-5e4a8f859605 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093374 Jun 22 10:24:36.292597 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 365/731] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jun 22 10:24:36 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:36.625718 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a1230ab9-3092-461c-9f90-0e3738903dfa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:36.626484 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a1230ab9-3092-461c-9f90-0e3738903dfa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:36.632430 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a1230ab9-3092-461c-9f90-0e3738903dfa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:36.632911 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a1230ab9-3092-461c-9f90-0e3738903dfa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:36.633683 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a1230ab9-3092-461c-9f90-0e3738903dfa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:36.634118 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a1230ab9-3092-461c-9f90-0e3738903dfa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:36.652329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:36.867878 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a1230ab9-3092-461c-9f90-0e3738903dfa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:36.875477 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a1230ab9-3092-461c-9f90-0e3738903dfa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.253672 Jun 22 10:24:36.876130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 367/732] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:36 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:37.348007 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-963b8617-e1c1-4bde-9050-d0b9e1bc7d1c req-1009645b-6847-4c13-af5c-4df5dd8525d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6", "tag": "c91bf175-3a15-4ba3-8e3a-92fa06cf2063"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:37.357857 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-963b8617-e1c1-4bde-9050-d0b9e1bc7d1c req-1009645b-6847-4c13-af5c-4df5dd8525d2 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:37.358518 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-963b8617-e1c1-4bde-9050-d0b9e1bc7d1c req-1009645b-6847-4c13-af5c-4df5dd8525d2 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:37.369799 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-963b8617-e1c1-4bde-9050-d0b9e1bc7d1c req-1009645b-6847-4c13-af5c-4df5dd8525d2 service nova] Creating event network-changed:c91bf175-3a15-4ba3-8e3a-92fa06cf2063 for instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 on hv-cinder-84327 Jun 22 10:24:37.375129 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-963b8617-e1c1-4bde-9050-d0b9e1bc7d1c req-1009645b-6847-4c13-af5c-4df5dd8525d2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031370 Jun 22 10:24:37.375564 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 366/733] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:37.892579 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-47881049-e95b-4bf6-8173-655e3083bb48 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:37.893727 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-47881049-e95b-4bf6-8173-655e3083bb48 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:37.901299 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-47881049-e95b-4bf6-8173-655e3083bb48 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:37.901299 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-47881049-e95b-4bf6-8173-655e3083bb48 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:37.902226 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-47881049-e95b-4bf6-8173-655e3083bb48 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:37.902752 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-47881049-e95b-4bf6-8173-655e3083bb48 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:38.049643 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-47881049-e95b-4bf6-8173-655e3083bb48 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:38.057385 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-47881049-e95b-4bf6-8173-655e3083bb48 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.168579 Jun 22 10:24:38.067655 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 368/734] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:37 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:39.076705 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a4a4f3a3-b3dc-4ebb-bb96-bda3c291c63d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:39.077442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a4a4f3a3-b3dc-4ebb-bb96-bda3c291c63d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:39.083872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4a4f3a3-b3dc-4ebb-bb96-bda3c291c63d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:39.084325 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4a4f3a3-b3dc-4ebb-bb96-bda3c291c63d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:39.085182 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4a4f3a3-b3dc-4ebb-bb96-bda3c291c63d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:39.085634 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4a4f3a3-b3dc-4ebb-bb96-bda3c291c63d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:39.214911 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a4a4f3a3-b3dc-4ebb-bb96-bda3c291c63d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:39.222405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a4a4f3a3-b3dc-4ebb-bb96-bda3c291c63d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1676 microversion: 2.1 time: 0.151145 Jun 22 10:24:39.222927 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 367/735] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:39 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:39.388981 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-4ccc95e4-10c1-41ad-abd9-13607777604b req-5abb8334-a35f-4f43-beb1-5fac737abfc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6", "tag": "c91bf175-3a15-4ba3-8e3a-92fa06cf2063"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:39.397609 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-4ccc95e4-10c1-41ad-abd9-13607777604b req-5abb8334-a35f-4f43-beb1-5fac737abfc8 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:39.398052 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-4ccc95e4-10c1-41ad-abd9-13607777604b req-5abb8334-a35f-4f43-beb1-5fac737abfc8 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:39.409234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-4ccc95e4-10c1-41ad-abd9-13607777604b req-5abb8334-a35f-4f43-beb1-5fac737abfc8 service nova] Creating event network-changed:c91bf175-3a15-4ba3-8e3a-92fa06cf2063 for instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 on hv-cinder-84327 Jun 22 10:24:39.414556 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-4ccc95e4-10c1-41ad-abd9-13607777604b req-5abb8334-a35f-4f43-beb1-5fac737abfc8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029263 Jun 22 10:24:39.415205 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 369/736] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:40.239463 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2569c44e-8d9f-41ae-9672-4a23bf5b921f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:40.239975 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2569c44e-8d9f-41ae-9672-4a23bf5b921f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:40.247079 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2569c44e-8d9f-41ae-9672-4a23bf5b921f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:40.247518 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2569c44e-8d9f-41ae-9672-4a23bf5b921f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:40.248269 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2569c44e-8d9f-41ae-9672-4a23bf5b921f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:40.248703 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2569c44e-8d9f-41ae-9672-4a23bf5b921f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:40.268276 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:40.383131 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2569c44e-8d9f-41ae-9672-4a23bf5b921f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:40.390654 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2569c44e-8d9f-41ae-9672-4a23bf5b921f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1653 microversion: 2.1 time: 0.155111 Jun 22 10:24:40.391225 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 368/737] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:40 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1653 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:40.430826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c60e31f5-6a35-4853-9bf0-c5422e519e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:40.437170 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c60e31f5-6a35-4853-9bf0-c5422e519e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:40.437623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c60e31f5-6a35-4853-9bf0-c5422e519e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:40.459348 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c60e31f5-6a35-4853-9bf0-c5422e519e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Going to try to start instance {{(pid=118326) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 10:24:40.753100 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c60e31f5-6a35-4853-9bf0-c5422e519e4a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "POST /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/action" status: 202 len: 0 microversion: 2.1 time: 0.326834 Jun 22 10:24:40.753706 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 370/738] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:24:40 2022] POST /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:24:40.762745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1cf31969-1f8d-4ed4-87b0-28836f14b6f9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:40.764491 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1cf31969-1f8d-4ed4-87b0-28836f14b6f9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:40.769710 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1cf31969-1f8d-4ed4-87b0-28836f14b6f9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:40.770169 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1cf31969-1f8d-4ed4-87b0-28836f14b6f9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:40.770981 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1cf31969-1f8d-4ed4-87b0-28836f14b6f9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:40.771418 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1cf31969-1f8d-4ed4-87b0-28836f14b6f9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:40.905033 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1cf31969-1f8d-4ed4-87b0-28836f14b6f9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:40.912901 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1cf31969-1f8d-4ed4-87b0-28836f14b6f9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1662 microversion: 2.1 time: 0.154644 Jun 22 10:24:40.913402 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 369/739] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:40 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:41.930551 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1d98d7eb-abfa-4334-9934-80f94851a794 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:41.931255 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1d98d7eb-abfa-4334-9934-80f94851a794 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:41.938051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1d98d7eb-abfa-4334-9934-80f94851a794 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:41.938499 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1d98d7eb-abfa-4334-9934-80f94851a794 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:41.939264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1d98d7eb-abfa-4334-9934-80f94851a794 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:41.939701 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1d98d7eb-abfa-4334-9934-80f94851a794 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:42.066047 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1d98d7eb-abfa-4334-9934-80f94851a794 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:42.074107 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1d98d7eb-abfa-4334-9934-80f94851a794 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1662 microversion: 2.1 time: 0.147640 Jun 22 10:24:42.074598 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 371/740] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:41 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1662 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:43.092036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fa4d1fbe-c33b-4972-b297-13f0f380224c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:43.092644 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-fa4d1fbe-c33b-4972-b297-13f0f380224c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:43.099147 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fa4d1fbe-c33b-4972-b297-13f0f380224c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:43.099638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fa4d1fbe-c33b-4972-b297-13f0f380224c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:43.100341 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fa4d1fbe-c33b-4972-b297-13f0f380224c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:43.100773 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fa4d1fbe-c33b-4972-b297-13f0f380224c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:43.232428 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-fa4d1fbe-c33b-4972-b297-13f0f380224c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:43.239998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-fa4d1fbe-c33b-4972-b297-13f0f380224c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1666 microversion: 2.1 time: 0.152804 Jun 22 10:24:43.240561 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 370/741] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:43 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1666 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:15.098604 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-72cfbdf0-2c38-4e0b-8e9a-5c8b3908ee25 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:15.099211 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-72cfbdf0-2c38-4e0b-8e9a-5c8b3908ee25 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:15.101465 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=31 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:15.102181 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:15.106834 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-72cfbdf0-2c38-4e0b-8e9a-5c8b3908ee25 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:15.107287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-72cfbdf0-2c38-4e0b-8e9a-5c8b3908ee25 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:15.108077 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-72cfbdf0-2c38-4e0b-8e9a-5c8b3908ee25 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:15.108512 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-72cfbdf0-2c38-4e0b-8e9a-5c8b3908ee25 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:15.139869 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-72cfbdf0-2c38-4e0b-8e9a-5c8b3908ee25 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-volume_attachments/05800d28-637f-4d80-a738-dcb7fd45da7e" status: 200 len: 194 microversion: 2.20 time: 0.045268 Jun 22 10:25:15.140452 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 372/742] 10.222.0.46 () {60 vars in 1453 bytes} [Wed Jun 22 10:25:15 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-volume_attachments/05800d28-637f-4d80-a738-dcb7fd45da7e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:25:15.204322 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-dd21fbec-0c14-45e5-925e-e31bfa10301e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:15.204862 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-dd21fbec-0c14-45e5-925e-e31bfa10301e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:15.207071 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=43 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:15.207731 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=14 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:15.212456 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dd21fbec-0c14-45e5-925e-e31bfa10301e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:15.212954 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dd21fbec-0c14-45e5-925e-e31bfa10301e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:15.213725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dd21fbec-0c14-45e5-925e-e31bfa10301e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:15.214164 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dd21fbec-0c14-45e5-925e-e31bfa10301e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:15.295218 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-dd21fbec-0c14-45e5-925e-e31bfa10301e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lazy-loading 'services' on Instance uuid 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:25:15.601529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-dd21fbec-0c14-45e5-925e-e31bfa10301e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "DELETE /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-volume_attachments/05800d28-637f-4d80-a738-dcb7fd45da7e" status: 202 len: 0 microversion: 2.20 time: 0.400859 Jun 22 10:25:15.602142 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 371/743] 10.222.0.46 () {60 vars in 1456 bytes} [Wed Jun 22 10:25:15 2022] DELETE /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-volume_attachments/05800d28-637f-4d80-a738-dcb7fd45da7e => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:25:15.611379 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4d3e36a5-ee96-4125-81f0-17090d947a73 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:15.612299 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4d3e36a5-ee96-4125-81f0-17090d947a73 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:15.618704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4d3e36a5-ee96-4125-81f0-17090d947a73 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:15.619150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4d3e36a5-ee96-4125-81f0-17090d947a73 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:15.619986 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4d3e36a5-ee96-4125-81f0-17090d947a73 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:15.620419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4d3e36a5-ee96-4125-81f0-17090d947a73 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:15.649405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4d3e36a5-ee96-4125-81f0-17090d947a73 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042361 Jun 22 10:25:15.652597 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 373/744] 10.222.0.46 () {60 vars in 1342 bytes} [Wed Jun 22 10:25:15 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:25:16.662741 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4e6e40bf-bd45-4e93-9c17-233883cc5108 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:16.663793 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4e6e40bf-bd45-4e93-9c17-233883cc5108 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:16.671146 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4e6e40bf-bd45-4e93-9c17-233883cc5108 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:16.671600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4e6e40bf-bd45-4e93-9c17-233883cc5108 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:16.672392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4e6e40bf-bd45-4e93-9c17-233883cc5108 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:16.672860 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4e6e40bf-bd45-4e93-9c17-233883cc5108 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:16.703585 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4e6e40bf-bd45-4e93-9c17-233883cc5108 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045943 Jun 22 10:25:16.704471 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 372/745] 10.222.0.46 () {60 vars in 1342 bytes} [Wed Jun 22 10:25:16 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:25:17.715567 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e5d3cc07-7396-4d1e-a68c-ee3973336155 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:17.716597 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e5d3cc07-7396-4d1e-a68c-ee3973336155 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:17.723824 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e5d3cc07-7396-4d1e-a68c-ee3973336155 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:17.724270 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e5d3cc07-7396-4d1e-a68c-ee3973336155 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:17.725056 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e5d3cc07-7396-4d1e-a68c-ee3973336155 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:17.725492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e5d3cc07-7396-4d1e-a68c-ee3973336155 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:17.754003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e5d3cc07-7396-4d1e-a68c-ee3973336155 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042345 Jun 22 10:25:17.754574 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 374/746] 10.222.0.46 () {60 vars in 1342 bytes} [Wed Jun 22 10:25:17 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:17.811196 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-360d749f-9b9d-48d1-acc3-20c503f88cc0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:17.811772 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-360d749f-9b9d-48d1-acc3-20c503f88cc0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:17.818323 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-360d749f-9b9d-48d1-acc3-20c503f88cc0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:17.818778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-360d749f-9b9d-48d1-acc3-20c503f88cc0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:17.819545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-360d749f-9b9d-48d1-acc3-20c503f88cc0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:17.819987 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-360d749f-9b9d-48d1-acc3-20c503f88cc0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:17.844571 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-360d749f-9b9d-48d1-acc3-20c503f88cc0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Going to try to terminate instance {{(pid=118327) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:25:17.995979 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:25:17.997632 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Wed Jun 22 10:25:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f (ip 10.222.0.46) !!! Jun 22 10:25:18.162556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-360d749f-9b9d-48d1-acc3-20c503f88cc0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "DELETE /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 204 len: 0 microversion: 2.20 time: 0.355470 Jun 22 10:25:18.163124 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 373/747] 10.222.0.46 () {60 vars in 1279 bytes} [Wed Jun 22 10:25:17 2022] DELETE /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 10:25:18.172220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-204b44bd-bc96-48dd-a0da-553331315ea3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:18.172982 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-204b44bd-bc96-48dd-a0da-553331315ea3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:18.179254 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-204b44bd-bc96-48dd-a0da-553331315ea3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:18.179704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-204b44bd-bc96-48dd-a0da-553331315ea3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:18.180592 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-204b44bd-bc96-48dd-a0da-553331315ea3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:18.181061 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-204b44bd-bc96-48dd-a0da-553331315ea3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:18.312694 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-204b44bd-bc96-48dd-a0da-553331315ea3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:18.320545 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-204b44bd-bc96-48dd-a0da-553331315ea3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:18.322093 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-204b44bd-bc96-48dd-a0da-553331315ea3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:18.323247 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-204b44bd-bc96-48dd-a0da-553331315ea3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.155851 Jun 22 10:25:18.323786 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 375/748] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:18 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:19.343355 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4d8da546-0753-47d3-baa0-cb4f4eb3f517 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:19.344096 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4d8da546-0753-47d3-baa0-cb4f4eb3f517 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:19.351332 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d8da546-0753-47d3-baa0-cb4f4eb3f517 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:19.351786 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d8da546-0753-47d3-baa0-cb4f4eb3f517 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:19.352717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d8da546-0753-47d3-baa0-cb4f4eb3f517 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:19.353183 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d8da546-0753-47d3-baa0-cb4f4eb3f517 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:19.488541 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4d8da546-0753-47d3-baa0-cb4f4eb3f517 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:19.497075 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4d8da546-0753-47d3-baa0-cb4f4eb3f517 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:19.498581 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4d8da546-0753-47d3-baa0-cb4f4eb3f517 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:19.499732 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4d8da546-0753-47d3-baa0-cb4f4eb3f517 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.161530 Jun 22 10:25:19.500282 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 374/749] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:19 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:20.518193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1c4aebe3-c0a8-4ce6-9ab3-c9c06d459f1e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:20.518800 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1c4aebe3-c0a8-4ce6-9ab3-c9c06d459f1e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:20.525320 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1c4aebe3-c0a8-4ce6-9ab3-c9c06d459f1e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:20.525770 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1c4aebe3-c0a8-4ce6-9ab3-c9c06d459f1e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:20.526535 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1c4aebe3-c0a8-4ce6-9ab3-c9c06d459f1e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:20.527018 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1c4aebe3-c0a8-4ce6-9ab3-c9c06d459f1e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:20.658134 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1c4aebe3-c0a8-4ce6-9ab3-c9c06d459f1e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:20.666647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1c4aebe3-c0a8-4ce6-9ab3-c9c06d459f1e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:20.668251 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1c4aebe3-c0a8-4ce6-9ab3-c9c06d459f1e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:20.669440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1c4aebe3-c0a8-4ce6-9ab3-c9c06d459f1e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1725 microversion: 2.20 time: 0.155177 Jun 22 10:25:20.670023 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 376/750] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:20 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:21.051100 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-82c684f7-9be7-4065-bc99-622fe665586c req-91598c3d-3af6-4830-8c1e-6dbd531bfa1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fa8c96-e39d-47ce-86a0-9d7d7eaf099f", "name": "network-vif-deleted", "tag": "9c2ee9e8-f445-4686-bacb-0cbc5c3c71de"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:21.063010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-82c684f7-9be7-4065-bc99-622fe665586c req-91598c3d-3af6-4830-8c1e-6dbd531bfa1f service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:21.063522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-82c684f7-9be7-4065-bc99-622fe665586c req-91598c3d-3af6-4830-8c1e-6dbd531bfa1f service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:21.075742 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-82c684f7-9be7-4065-bc99-622fe665586c req-91598c3d-3af6-4830-8c1e-6dbd531bfa1f service nova] Creating event network-vif-deleted:9c2ee9e8-f445-4686-bacb-0cbc5c3c71de for instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f on hv-cinder-84327 Jun 22 10:25:21.081672 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-82c684f7-9be7-4065-bc99-622fe665586c req-91598c3d-3af6-4830-8c1e-6dbd531bfa1f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091906 Jun 22 10:25:21.082374 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 375/751] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:21.687586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:21.688191 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:21.695205 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:21.695655 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:21.696786 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:21.697195 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:21.733767 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:21.734279 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:21.734740 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lazy-loading 'fault' on Instance uuid 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:25:21.782576 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:21.792538 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:21.794874 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:21.796311 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e0983a2f-81af-488e-8845-b59d93360ceb tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 200 len: 1371 microversion: 2.20 time: 0.112703 Jun 22 10:25:21.797062 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 377/752] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:21 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 1371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:22.815839 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4b670a75-dd60-4574-9071-472c446b8979 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:22.816665 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4b670a75-dd60-4574-9071-472c446b8979 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:22.824030 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4b670a75-dd60-4574-9071-472c446b8979 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:22.824482 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4b670a75-dd60-4574-9071-472c446b8979 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:22.825334 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4b670a75-dd60-4574-9071-472c446b8979 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:22.825770 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4b670a75-dd60-4574-9071-472c446b8979 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:22.840789 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-4b670a75-dd60-4574-9071-472c446b8979 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] HTTP exception thrown: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4b670a75-dd60-4574-9071-472c446b8979 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Request method failure captured: Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f HTTP/1.1 Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisux88luJMz48v1B7FXhyA5Io-xLo6beC-rU41S5hxsLUNac1d5NSKUY62KeC6KE1TTy3RhUiiERYbxKsKKsmIdEAiYCy9Q_H3dcXtkdEB8xLUPktZWEbldETa9F9a2ADVwYo6GNu1OWuum1EmybzP8EoHjjxiiyDledLo9m8ZB6ImZM Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: b3fed4f483e84ec7a10b96de33677cbc Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:25:22.842405 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:25:22.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3fed4f483e84ec7a10b96de33677cbc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:25:22.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:25:22.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: b3fed4f483e84ec7a10b96de33677cbc Jun 22 10:25:22.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:25:22.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-AttachVolumeShelveTestJSON-517259058-project Jun 22 10:25:22.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:25:22.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:25:22.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: cef533d7373946dcb340fbf496070e9f Jun 22 10:25:22.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-AttachVolumeShelveTestJSON-517259058-project Jun 22 10:25:22.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:25:22.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:25:22.844123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '86fa8c96-e39d-47ce-86a0-9d7d7eaf099f'} Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:25:22.845126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:25:22.846837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:22.848206 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4b670a75-dd60-4574-9071-472c446b8979 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Returning 404 to user: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:25:22.848206 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4b670a75-dd60-4574-9071-472c446b8979 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 404 len: 111 microversion: 2.20 time: 0.032437 Jun 22 10:25:22.848206 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 376/753] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:22 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:25:22.853257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-59f1d5ba-0fe3-44b6-94b7-ff060bf5089a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '.version_select at 0x7f021fc695e0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:23.009549 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-59f1d5ba-0fe3-44b6-94b7-ff060bf5089a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886350199" status: 204 len: 0 microversion: 2.20 time: 0.160243 Jun 22 10:25:23.010133 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 378/754] 10.222.0.46 () {60 vars in 1261 bytes} [Wed Jun 22 10:25:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886350199 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 10:25:23.864249 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7e2fdd49-1678-4141-bfbc-ea5e49a4ae46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Action: 'create', calling method: .version_select at 0x7f021fbcfc10>, body: {"keypair": {"name": "tempest-keypair-1562922999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFy9LXY0x1NyKBBZwD22jb4Kz1Lxwr7POH27lqM3zq7KsEOF1Gxf9Xb3Kv9u+vNEoP3U1aQH4NYUaxDnDjnnXwams5Ue5gKfZnmkK9ME6KxLDwZnp3cw0oPt/uaR1kHZ3Q=="}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:23.876495 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-7e2fdd49-1678-4141-bfbc-ea5e49a4ae46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Getting quotas for project b3fed4f483e84ec7a10b96de33677cbc. Resources: {'key_pairs'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:25:23.880714 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-7e2fdd49-1678-4141-bfbc-ea5e49a4ae46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Getting quotas for user cef533d7373946dcb340fbf496070e9f and project b3fed4f483e84ec7a10b96de33677cbc. Resources: {'key_pairs'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:25:24.004380 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7e2fdd49-1678-4141-bfbc-ea5e49a4ae46 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.147296 Jun 22 10:25:24.005102 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 377/755] 10.222.0.46 () {62 vars in 1199 bytes} [Wed Jun 22 10:25:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 10:25:26.526449 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-512311129", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5b06f66-fceb-42a0-91a2-b45c69aaa8d7"}], "security_groups": [{"name": "tempest-securitygroup--355791781"}], "key_name": "tempest-keypair-1562922999", "user_data": "}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:26.628837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.network.neutron [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] validate_networks() for [('c5b06f66-fceb-42a0-91a2-b45c69aaa8d7', None, None, None, None, None)] {{(pid=118326) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:25:27.038095 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Flavor limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:25:27.038525 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Image limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:25:27.039008 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Flavor pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:25:27.039420 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Image pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:25:27.039833 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:25:27.049527 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:27.049976 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:27.050777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:27.051216 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:27.067705 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Getting quotas for project b3fed4f483e84ec7a10b96de33677cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:25:27.071661 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Getting quotas for user cef533d7373946dcb340fbf496070e9f and project b3fed4f483e84ec7a10b96de33677cbc. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:25:27.082576 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Going to run 1 instances... {{(pid=118326) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:25:27.084845 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118326) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:25:27.274722 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b25eecb1-8c2c-41d5-90ff-ca36a6d5923f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.753110 Jun 22 10:25:27.275697 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 379/756] 10.222.0.46 () {62 vars in 1187 bytes} [Wed Jun 22 10:25:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 22 10:25:27.286994 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-de7a4fc2-5aae-45e0-9ace-1e6aa544f720 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:27.287607 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-de7a4fc2-5aae-45e0-9ace-1e6aa544f720 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:27.344842 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-de7a4fc2-5aae-45e0-9ace-1e6aa544f720 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:27.351943 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-de7a4fc2-5aae-45e0-9ace-1e6aa544f720 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:27.353818 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-de7a4fc2-5aae-45e0-9ace-1e6aa544f720 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:27.355438 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-de7a4fc2-5aae-45e0-9ace-1e6aa544f720 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1281 microversion: 2.20 time: 0.073186 Jun 22 10:25:27.365632 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 378/757] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:27 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:28.285194 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-aa58022a-0433-4d19-a045-ffbaca4b9e8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:28.286138 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-aa58022a-0433-4d19-a045-ffbaca4b9e8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:28.293514 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aa58022a-0433-4d19-a045-ffbaca4b9e8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:28.301473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aa58022a-0433-4d19-a045-ffbaca4b9e8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:28.301473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aa58022a-0433-4d19-a045-ffbaca4b9e8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:28.301473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aa58022a-0433-4d19-a045-ffbaca4b9e8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:28.372810 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d1dbf952-71db-49ec-b004-ec24b2df4759 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:28.373444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d1dbf952-71db-49ec-b004-ec24b2df4759 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:28.430268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d1dbf952-71db-49ec-b004-ec24b2df4759 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:28.437942 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d1dbf952-71db-49ec-b004-ec24b2df4759 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:28.439451 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d1dbf952-71db-49ec-b004-ec24b2df4759 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:28.440547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d1dbf952-71db-49ec-b004-ec24b2df4759 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1281 microversion: 2.20 time: 0.071787 Jun 22 10:25:28.441142 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 379/758] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:28 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:25:28.532912 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-aa58022a-0433-4d19-a045-ffbaca4b9e8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "POST /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/action" status: 202 len: 0 microversion: 2.1 time: 0.251568 Jun 22 10:25:28.533559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 380/759] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:25:28 2022] POST /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:25:28.541805 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9684d55e-b911-4e95-bd8d-a4252474d524 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:28.542629 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9684d55e-b911-4e95-bd8d-a4252474d524 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:28.548709 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9684d55e-b911-4e95-bd8d-a4252474d524 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:28.549210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9684d55e-b911-4e95-bd8d-a4252474d524 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:28.549980 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9684d55e-b911-4e95-bd8d-a4252474d524 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:28.550420 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9684d55e-b911-4e95-bd8d-a4252474d524 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:28.692510 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9684d55e-b911-4e95-bd8d-a4252474d524 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:28.701327 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9684d55e-b911-4e95-bd8d-a4252474d524 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1752 microversion: 2.1 time: 0.163339 Jun 22 10:25:28.701907 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 380/760] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:28 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:25:29.459046 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c2d0b2bf-ebc8-4386-92b0-01a7d7fedf13 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:29.459772 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c2d0b2bf-ebc8-4386-92b0-01a7d7fedf13 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:29.466539 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c2d0b2bf-ebc8-4386-92b0-01a7d7fedf13 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:29.474229 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c2d0b2bf-ebc8-4386-92b0-01a7d7fedf13 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:29.474229 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c2d0b2bf-ebc8-4386-92b0-01a7d7fedf13 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:29.474229 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c2d0b2bf-ebc8-4386-92b0-01a7d7fedf13 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:29.533775 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c2d0b2bf-ebc8-4386-92b0-01a7d7fedf13 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:29.542154 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c2d0b2bf-ebc8-4386-92b0-01a7d7fedf13 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:29.544269 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c2d0b2bf-ebc8-4386-92b0-01a7d7fedf13 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:29.545308 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c2d0b2bf-ebc8-4386-92b0-01a7d7fedf13 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1333 microversion: 2.20 time: 0.090682 Jun 22 10:25:29.545969 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 381/761] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:29 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:29.719097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b716b640-c5b0-48bd-9193-93fe903791a8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:29.719645 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b716b640-c5b0-48bd-9193-93fe903791a8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:29.726213 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b716b640-c5b0-48bd-9193-93fe903791a8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:29.726669 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b716b640-c5b0-48bd-9193-93fe903791a8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:29.727428 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b716b640-c5b0-48bd-9193-93fe903791a8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:29.727863 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b716b640-c5b0-48bd-9193-93fe903791a8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:29.880144 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b716b640-c5b0-48bd-9193-93fe903791a8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:29.888543 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b716b640-c5b0-48bd-9193-93fe903791a8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1757 microversion: 2.1 time: 0.173278 Jun 22 10:25:29.889162 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 381/762] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:29 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:30.563614 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-895fd37e-3b18-45bf-94cd-018240b069f5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:30.564225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-895fd37e-3b18-45bf-94cd-018240b069f5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:30.570807 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-895fd37e-3b18-45bf-94cd-018240b069f5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:30.571268 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-895fd37e-3b18-45bf-94cd-018240b069f5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:30.572022 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-895fd37e-3b18-45bf-94cd-018240b069f5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:30.572451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-895fd37e-3b18-45bf-94cd-018240b069f5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:30.639604 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-895fd37e-3b18-45bf-94cd-018240b069f5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:30.651350 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-895fd37e-3b18-45bf-94cd-018240b069f5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:30.654351 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-895fd37e-3b18-45bf-94cd-018240b069f5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:30.655706 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-895fd37e-3b18-45bf-94cd-018240b069f5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1351 microversion: 2.20 time: 0.096257 Jun 22 10:25:30.656423 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 382/763] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:30 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:30.906816 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b051838a-8456-4705-b5ee-62fc447cd09d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:30.907533 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b051838a-8456-4705-b5ee-62fc447cd09d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:30.914533 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b051838a-8456-4705-b5ee-62fc447cd09d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:30.914988 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b051838a-8456-4705-b5ee-62fc447cd09d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:30.915792 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b051838a-8456-4705-b5ee-62fc447cd09d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:30.916230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b051838a-8456-4705-b5ee-62fc447cd09d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:31.061768 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b051838a-8456-4705-b5ee-62fc447cd09d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:31.069933 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b051838a-8456-4705-b5ee-62fc447cd09d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1757 microversion: 2.1 time: 0.167089 Jun 22 10:25:31.070510 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 382/764] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:30 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:31.675959 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e534523d-9f90-41a2-aecd-f84b234973f7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:31.676487 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e534523d-9f90-41a2-aecd-f84b234973f7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:31.683249 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e534523d-9f90-41a2-aecd-f84b234973f7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:31.683704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e534523d-9f90-41a2-aecd-f84b234973f7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:31.684481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e534523d-9f90-41a2-aecd-f84b234973f7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:31.684955 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e534523d-9f90-41a2-aecd-f84b234973f7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:31.822174 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e534523d-9f90-41a2-aecd-f84b234973f7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:31.831862 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e534523d-9f90-41a2-aecd-f84b234973f7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:31.833492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e534523d-9f90-41a2-aecd-f84b234973f7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:31.834678 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e534523d-9f90-41a2-aecd-f84b234973f7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1406 microversion: 2.20 time: 0.162819 Jun 22 10:25:31.837719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 383/765] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:31 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:32.087862 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f95c0342-f0d3-46e6-9766-3cffdd7132f6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:32.092984 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f95c0342-f0d3-46e6-9766-3cffdd7132f6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:32.099120 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f95c0342-f0d3-46e6-9766-3cffdd7132f6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:32.099948 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f95c0342-f0d3-46e6-9766-3cffdd7132f6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:32.101420 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f95c0342-f0d3-46e6-9766-3cffdd7132f6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:32.102269 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f95c0342-f0d3-46e6-9766-3cffdd7132f6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:32.264995 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f95c0342-f0d3-46e6-9766-3cffdd7132f6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:32.274798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f95c0342-f0d3-46e6-9766-3cffdd7132f6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1757 microversion: 2.1 time: 0.191023 Jun 22 10:25:32.275381 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 383/766] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:32 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:32.839428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-c39f1094-3fd3-4c26-bc28-b6fa934c7b74 req-59feb823-54cd-4713-a5fc-a01838e70fbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e", "tag": "dbfaa146-96f3-4722-9a6e-f6764ddb4ef2"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:32.854219 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d1ac4b50-ac38-40c2-9768-71526a347e6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:32.860596 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d1ac4b50-ac38-40c2-9768-71526a347e6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:32.864062 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-c39f1094-3fd3-4c26-bc28-b6fa934c7b74 req-59feb823-54cd-4713-a5fc-a01838e70fbc service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:32.864631 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-c39f1094-3fd3-4c26-bc28-b6fa934c7b74 req-59feb823-54cd-4713-a5fc-a01838e70fbc service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:32.869133 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d1ac4b50-ac38-40c2-9768-71526a347e6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:32.869596 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d1ac4b50-ac38-40c2-9768-71526a347e6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:32.870461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d1ac4b50-ac38-40c2-9768-71526a347e6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:32.871825 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d1ac4b50-ac38-40c2-9768-71526a347e6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:32.886117 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-c39f1094-3fd3-4c26-bc28-b6fa934c7b74 req-59feb823-54cd-4713-a5fc-a01838e70fbc service nova] Creating event network-changed:dbfaa146-96f3-4722-9a6e-f6764ddb4ef2 for instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e on hv-cinder-84327 Jun 22 10:25:32.891090 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-c39f1094-3fd3-4c26-bc28-b6fa934c7b74 req-59feb823-54cd-4713-a5fc-a01838e70fbc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056902 Jun 22 10:25:32.892287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 384/767] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:33.026084 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d1ac4b50-ac38-40c2-9768-71526a347e6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:33.034902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d1ac4b50-ac38-40c2-9768-71526a347e6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:33.036804 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d1ac4b50-ac38-40c2-9768-71526a347e6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:33.038031 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d1ac4b50-ac38-40c2-9768-71526a347e6a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1406 microversion: 2.20 time: 0.187767 Jun 22 10:25:33.038689 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 384/768] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:32 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:25:33.292345 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-02f3c803-b88c-4808-964d-b5841cb07f8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:33.293133 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-02f3c803-b88c-4808-964d-b5841cb07f8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:33.299675 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-02f3c803-b88c-4808-964d-b5841cb07f8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:33.300128 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-02f3c803-b88c-4808-964d-b5841cb07f8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:33.300970 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-02f3c803-b88c-4808-964d-b5841cb07f8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:33.301410 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-02f3c803-b88c-4808-964d-b5841cb07f8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:33.450081 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-02f3c803-b88c-4808-964d-b5841cb07f8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:33.458089 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-02f3c803-b88c-4808-964d-b5841cb07f8c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1757 microversion: 2.1 time: 0.170069 Jun 22 10:25:33.458657 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 385/769] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:33 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:34.055890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9e147067-4d1b-4f78-ba01-2319440d471d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:34.056509 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9e147067-4d1b-4f78-ba01-2319440d471d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:34.063851 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9e147067-4d1b-4f78-ba01-2319440d471d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:34.064299 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9e147067-4d1b-4f78-ba01-2319440d471d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:34.065086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9e147067-4d1b-4f78-ba01-2319440d471d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:34.065525 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9e147067-4d1b-4f78-ba01-2319440d471d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:34.202647 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9e147067-4d1b-4f78-ba01-2319440d471d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:34.211969 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9e147067-4d1b-4f78-ba01-2319440d471d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:34.213505 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9e147067-4d1b-4f78-ba01-2319440d471d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:34.214605 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9e147067-4d1b-4f78-ba01-2319440d471d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1406 microversion: 2.20 time: 0.162633 Jun 22 10:25:34.215162 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 385/770] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:34 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:34.476015 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bb6e4f6e-dc7b-4776-8d34-fe5d569eb548 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:34.476562 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bb6e4f6e-dc7b-4776-8d34-fe5d569eb548 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:34.483777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb6e4f6e-dc7b-4776-8d34-fe5d569eb548 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:34.484230 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb6e4f6e-dc7b-4776-8d34-fe5d569eb548 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:34.485055 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb6e4f6e-dc7b-4776-8d34-fe5d569eb548 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:34.485500 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb6e4f6e-dc7b-4776-8d34-fe5d569eb548 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:34.632302 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bb6e4f6e-dc7b-4776-8d34-fe5d569eb548 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:34.640442 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bb6e4f6e-dc7b-4776-8d34-fe5d569eb548 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1757 microversion: 2.1 time: 0.168447 Jun 22 10:25:34.641037 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 386/771] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:34 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:35.236388 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2ba4b60d-e944-4a82-9d84-d5b36eaf35a6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:35.237034 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2ba4b60d-e944-4a82-9d84-d5b36eaf35a6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:35.243287 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2ba4b60d-e944-4a82-9d84-d5b36eaf35a6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:35.243744 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2ba4b60d-e944-4a82-9d84-d5b36eaf35a6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:35.244520 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2ba4b60d-e944-4a82-9d84-d5b36eaf35a6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:35.244996 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2ba4b60d-e944-4a82-9d84-d5b36eaf35a6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:35.372968 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2ba4b60d-e944-4a82-9d84-d5b36eaf35a6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:35.381032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2ba4b60d-e944-4a82-9d84-d5b36eaf35a6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:35.382601 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2ba4b60d-e944-4a82-9d84-d5b36eaf35a6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:35.383773 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2ba4b60d-e944-4a82-9d84-d5b36eaf35a6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1406 microversion: 2.20 time: 0.151525 Jun 22 10:25:35.384341 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 386/772] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:35 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:35.664932 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-87a8228c-68e7-4af6-85b1-0cfb4eeb2d0d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:35.664932 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-87a8228c-68e7-4af6-85b1-0cfb4eeb2d0d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:35.665720 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-87a8228c-68e7-4af6-85b1-0cfb4eeb2d0d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:35.666426 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-87a8228c-68e7-4af6-85b1-0cfb4eeb2d0d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:35.667425 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-87a8228c-68e7-4af6-85b1-0cfb4eeb2d0d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:35.668377 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-87a8228c-68e7-4af6-85b1-0cfb4eeb2d0d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:35.814378 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-87a8228c-68e7-4af6-85b1-0cfb4eeb2d0d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:35.822320 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-87a8228c-68e7-4af6-85b1-0cfb4eeb2d0d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1757 microversion: 2.1 time: 0.168529 Jun 22 10:25:35.822867 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 387/773] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:35 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:36.403658 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-41098684-424e-4ed2-8118-9f95450419d6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:36.404365 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-41098684-424e-4ed2-8118-9f95450419d6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:36.411285 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-41098684-424e-4ed2-8118-9f95450419d6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:36.412002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-41098684-424e-4ed2-8118-9f95450419d6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:36.412895 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-41098684-424e-4ed2-8118-9f95450419d6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:36.413334 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-41098684-424e-4ed2-8118-9f95450419d6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:36.547971 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-41098684-424e-4ed2-8118-9f95450419d6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:36.555949 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-41098684-424e-4ed2-8118-9f95450419d6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:36.557530 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-41098684-424e-4ed2-8118-9f95450419d6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:36.558681 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-41098684-424e-4ed2-8118-9f95450419d6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1406 microversion: 2.20 time: 0.160115 Jun 22 10:25:36.559239 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 387/774] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:36 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:36.839690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-36ab006c-86d2-436e-b4b4-a273aeb20ead tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:36.844764 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-36ab006c-86d2-436e-b4b4-a273aeb20ead tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:36.846864 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-36ab006c-86d2-436e-b4b4-a273aeb20ead tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:36.847308 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-36ab006c-86d2-436e-b4b4-a273aeb20ead tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:36.848059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-36ab006c-86d2-436e-b4b4-a273aeb20ead tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:36.848485 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-36ab006c-86d2-436e-b4b4-a273aeb20ead tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:36.994626 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-36ab006c-86d2-436e-b4b4-a273aeb20ead tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:37.002977 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-36ab006c-86d2-436e-b4b4-a273aeb20ead tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1757 microversion: 2.1 time: 0.167172 Jun 22 10:25:37.003537 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 388/775] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:36 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:37.575486 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b996c4b8-63b0-478f-b96b-b9f20f74c02e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:37.576094 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b996c4b8-63b0-478f-b96b-b9f20f74c02e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:37.582842 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b996c4b8-63b0-478f-b96b-b9f20f74c02e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:37.583286 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b996c4b8-63b0-478f-b96b-b9f20f74c02e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:37.584045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b996c4b8-63b0-478f-b96b-b9f20f74c02e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:37.584482 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b996c4b8-63b0-478f-b96b-b9f20f74c02e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:37.716462 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b996c4b8-63b0-478f-b96b-b9f20f74c02e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:37.724872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b996c4b8-63b0-478f-b96b-b9f20f74c02e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:37.726541 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b996c4b8-63b0-478f-b96b-b9f20f74c02e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:37.727646 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b996c4b8-63b0-478f-b96b-b9f20f74c02e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1406 microversion: 2.20 time: 0.156103 Jun 22 10:25:37.728229 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 388/776] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:37 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:37.967940 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:37.969050 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=6 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:38.021440 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5d8ee5ab-e859-4ee6-8d9c-10c94f0dd48d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:38.022137 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5d8ee5ab-e859-4ee6-8d9c-10c94f0dd48d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:38.023639 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-f67e40b5-5c11-4696-91e1-0558739e423f req-a09a644d-c602-488d-b34f-0b2e36348ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e", "name": "network-vif-plugged", "status": "completed", "tag": "dbfaa146-96f3-4722-9a6e-f6764ddb4ef2"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:38.028897 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5d8ee5ab-e859-4ee6-8d9c-10c94f0dd48d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:38.029348 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5d8ee5ab-e859-4ee6-8d9c-10c94f0dd48d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:38.030112 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5d8ee5ab-e859-4ee6-8d9c-10c94f0dd48d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:38.030549 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5d8ee5ab-e859-4ee6-8d9c-10c94f0dd48d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:38.032594 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-f67e40b5-5c11-4696-91e1-0558739e423f req-a09a644d-c602-488d-b34f-0b2e36348ffa service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:38.033083 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-f67e40b5-5c11-4696-91e1-0558739e423f req-a09a644d-c602-488d-b34f-0b2e36348ffa service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:38.044230 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-f67e40b5-5c11-4696-91e1-0558739e423f req-a09a644d-c602-488d-b34f-0b2e36348ffa service nova] Creating event network-vif-plugged:dbfaa146-96f3-4722-9a6e-f6764ddb4ef2 for instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e on hv-cinder-84327 Jun 22 10:25:38.049038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:38.049321 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-f67e40b5-5c11-4696-91e1-0558739e423f req-a09a644d-c602-488d-b34f-0b2e36348ffa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086389 Jun 22 10:25:38.049933 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 389/777] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:38.188085 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5d8ee5ab-e859-4ee6-8d9c-10c94f0dd48d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:38.200392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5d8ee5ab-e859-4ee6-8d9c-10c94f0dd48d tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1757 microversion: 2.1 time: 0.183102 Jun 22 10:25:38.206910 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 389/778] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:38 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:25:38.752320 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c57d6ca9-3c4a-4e4e-a42b-326af4affdc2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:38.753003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c57d6ca9-3c4a-4e4e-a42b-326af4affdc2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:38.759622 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c57d6ca9-3c4a-4e4e-a42b-326af4affdc2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:38.760071 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c57d6ca9-3c4a-4e4e-a42b-326af4affdc2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:38.760842 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c57d6ca9-3c4a-4e4e-a42b-326af4affdc2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:38.761792 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c57d6ca9-3c4a-4e4e-a42b-326af4affdc2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:38.765897 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:38.892252 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c57d6ca9-3c4a-4e4e-a42b-326af4affdc2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:38.900214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c57d6ca9-3c4a-4e4e-a42b-326af4affdc2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:38.901784 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c57d6ca9-3c4a-4e4e-a42b-326af4affdc2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:38.903520 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c57d6ca9-3c4a-4e4e-a42b-326af4affdc2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1406 microversion: 2.20 time: 0.156261 Jun 22 10:25:38.904079 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 390/779] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:38 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:39.223710 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-71a3c4ac-1fa8-48b8-af3c-26d0ffcaed9e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:39.224331 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-71a3c4ac-1fa8-48b8-af3c-26d0ffcaed9e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:39.226189 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=8 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:39.231927 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71a3c4ac-1fa8-48b8-af3c-26d0ffcaed9e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:39.232377 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71a3c4ac-1fa8-48b8-af3c-26d0ffcaed9e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:39.233213 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71a3c4ac-1fa8-48b8-af3c-26d0ffcaed9e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:39.233647 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71a3c4ac-1fa8-48b8-af3c-26d0ffcaed9e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:39.375175 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-71a3c4ac-1fa8-48b8-af3c-26d0ffcaed9e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:39.383168 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-71a3c4ac-1fa8-48b8-af3c-26d0ffcaed9e tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1757 microversion: 2.1 time: 0.163671 Jun 22 10:25:39.383745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 390/780] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:39 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:39.922467 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9d6b0de2-892b-4826-95c3-cd861b85c0f2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:39.923074 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9d6b0de2-892b-4826-95c3-cd861b85c0f2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:39.930235 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9d6b0de2-892b-4826-95c3-cd861b85c0f2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:39.930684 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9d6b0de2-892b-4826-95c3-cd861b85c0f2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:39.931453 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9d6b0de2-892b-4826-95c3-cd861b85c0f2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:39.931899 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9d6b0de2-892b-4826-95c3-cd861b85c0f2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:40.064362 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9d6b0de2-892b-4826-95c3-cd861b85c0f2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:40.072274 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9d6b0de2-892b-4826-95c3-cd861b85c0f2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:40.073801 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9d6b0de2-892b-4826-95c3-cd861b85c0f2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:40.075397 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9d6b0de2-892b-4826-95c3-cd861b85c0f2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1406 microversion: 2.20 time: 0.157593 Jun 22 10:25:40.075959 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 391/781] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:39 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:40.400236 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4233f5cd-5bb1-4952-9754-ea1262927db3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:40.400876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4233f5cd-5bb1-4952-9754-ea1262927db3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:40.408902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4233f5cd-5bb1-4952-9754-ea1262927db3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:40.409351 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4233f5cd-5bb1-4952-9754-ea1262927db3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:40.410122 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4233f5cd-5bb1-4952-9754-ea1262927db3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:40.410625 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4233f5cd-5bb1-4952-9754-ea1262927db3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:40.556647 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4233f5cd-5bb1-4952-9754-ea1262927db3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:40.565365 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4233f5cd-5bb1-4952-9754-ea1262927db3 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1757 microversion: 2.1 time: 0.169701 Jun 22 10:25:40.565952 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 391/782] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:40 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:41.093601 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3c798993-732a-4442-80f0-ddf40a9f8712 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:41.094204 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3c798993-732a-4442-80f0-ddf40a9f8712 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:41.100183 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3c798993-732a-4442-80f0-ddf40a9f8712 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:41.100625 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3c798993-732a-4442-80f0-ddf40a9f8712 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:41.101418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3c798993-732a-4442-80f0-ddf40a9f8712 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:41.101850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3c798993-732a-4442-80f0-ddf40a9f8712 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:41.234840 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3c798993-732a-4442-80f0-ddf40a9f8712 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:41.242992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3c798993-732a-4442-80f0-ddf40a9f8712 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:41.244476 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3c798993-732a-4442-80f0-ddf40a9f8712 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:41.245641 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3c798993-732a-4442-80f0-ddf40a9f8712 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1598 microversion: 2.20 time: 0.157187 Jun 22 10:25:41.246271 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 392/783] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:41 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:41.262954 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-292af2ff-3f0b-4cc1-ba32-959c226dbf40 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:41.263464 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-292af2ff-3f0b-4cc1-ba32-959c226dbf40 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:41.269519 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-292af2ff-3f0b-4cc1-ba32-959c226dbf40 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:41.269962 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-292af2ff-3f0b-4cc1-ba32-959c226dbf40 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:41.270775 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-292af2ff-3f0b-4cc1-ba32-959c226dbf40 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:41.271207 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-292af2ff-3f0b-4cc1-ba32-959c226dbf40 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:41.349364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-292af2ff-3f0b-4cc1-ba32-959c226dbf40 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090167 Jun 22 10:25:41.349957 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 392/784] 10.222.0.46 () {60 vars in 1315 bytes} [Wed Jun 22 10:25:41 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:25:41.584107 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-91b9136e-a0e7-47c1-8ea1-3c9c695e5106 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:41.584724 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-91b9136e-a0e7-47c1-8ea1-3c9c695e5106 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:41.591118 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-91b9136e-a0e7-47c1-8ea1-3c9c695e5106 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:41.591574 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-91b9136e-a0e7-47c1-8ea1-3c9c695e5106 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:41.592356 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-91b9136e-a0e7-47c1-8ea1-3c9c695e5106 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:41.592794 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-91b9136e-a0e7-47c1-8ea1-3c9c695e5106 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:41.883090 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-91b9136e-a0e7-47c1-8ea1-3c9c695e5106 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:41.891552 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-91b9136e-a0e7-47c1-8ea1-3c9c695e5106 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1757 microversion: 2.1 time: 0.311327 Jun 22 10:25:41.892328 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 393/785] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:41 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1757 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:42.705794 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-17ba1012-6270-49b3-be79-32a3fb877799 req-f8d89785-4667-44d7-ae5e-1dd3b0eb9d70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e", "tag": "dbfaa146-96f3-4722-9a6e-f6764ddb4ef2"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:42.713722 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-17ba1012-6270-49b3-be79-32a3fb877799 req-f8d89785-4667-44d7-ae5e-1dd3b0eb9d70 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:42.714158 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-17ba1012-6270-49b3-be79-32a3fb877799 req-f8d89785-4667-44d7-ae5e-1dd3b0eb9d70 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:42.725777 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-17ba1012-6270-49b3-be79-32a3fb877799 req-f8d89785-4667-44d7-ae5e-1dd3b0eb9d70 service nova] Creating event network-changed:dbfaa146-96f3-4722-9a6e-f6764ddb4ef2 for instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e on hv-cinder-84327 Jun 22 10:25:42.730839 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-17ba1012-6270-49b3-be79-32a3fb877799 req-f8d89785-4667-44d7-ae5e-1dd3b0eb9d70 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029111 Jun 22 10:25:42.731439 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 393/786] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:42.909102 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5c229d52-33f9-435f-b25a-76f5f45bd970 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:42.909716 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5c229d52-33f9-435f-b25a-76f5f45bd970 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:42.916889 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5c229d52-33f9-435f-b25a-76f5f45bd970 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:42.917321 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5c229d52-33f9-435f-b25a-76f5f45bd970 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:42.918308 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5c229d52-33f9-435f-b25a-76f5f45bd970 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:42.918842 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5c229d52-33f9-435f-b25a-76f5f45bd970 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:43.076964 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5c229d52-33f9-435f-b25a-76f5f45bd970 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:43.087509 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5c229d52-33f9-435f-b25a-76f5f45bd970 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1760 microversion: 2.1 time: 0.182157 Jun 22 10:25:43.088074 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 394/787] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:42 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1760 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:43.846444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4dd2aee6-d60f-4763-8c9a-1ad6ae391a94 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:43.847021 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4dd2aee6-d60f-4763-8c9a-1ad6ae391a94 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:43.853559 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4dd2aee6-d60f-4763-8c9a-1ad6ae391a94 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:43.854017 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4dd2aee6-d60f-4763-8c9a-1ad6ae391a94 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:43.854795 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4dd2aee6-d60f-4763-8c9a-1ad6ae391a94 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:43.855232 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4dd2aee6-d60f-4763-8c9a-1ad6ae391a94 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:43.936180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-4dd2aee6-d60f-4763-8c9a-1ad6ae391a94 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lazy-loading 'services' on Instance uuid 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:25:44.412840 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4dd2aee6-d60f-4763-8c9a-1ad6ae391a94 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments/27521dce-bad8-4675-9f87-2190bd984c2c" status: 202 len: 0 microversion: 2.1 time: 0.571645 Jun 22 10:25:44.413490 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 394/788] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jun 22 10:25:43 2022] DELETE /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments/27521dce-bad8-4675-9f87-2190bd984c2c => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:25:44.422182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-91eb3f07-7c6f-4b6b-91ee-fad4dd75b007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:44.423126 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-91eb3f07-7c6f-4b6b-91ee-fad4dd75b007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:44.429684 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-91eb3f07-7c6f-4b6b-91ee-fad4dd75b007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:44.430135 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-91eb3f07-7c6f-4b6b-91ee-fad4dd75b007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:44.430905 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-91eb3f07-7c6f-4b6b-91ee-fad4dd75b007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:44.431343 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-91eb3f07-7c6f-4b6b-91ee-fad4dd75b007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:44.461217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-91eb3f07-7c6f-4b6b-91ee-fad4dd75b007 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043113 Jun 22 10:25:44.461772 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 395/789] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:25:44 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:45.474423 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9678486e-0a86-449d-862c-5f3acc125958 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:45.477588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9678486e-0a86-449d-862c-5f3acc125958 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:45.477588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:45.482449 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9678486e-0a86-449d-862c-5f3acc125958 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:45.482900 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9678486e-0a86-449d-862c-5f3acc125958 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:45.483676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9678486e-0a86-449d-862c-5f3acc125958 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:45.484131 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9678486e-0a86-449d-862c-5f3acc125958 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:45.515606 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9678486e-0a86-449d-862c-5f3acc125958 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Jun 22 10:25:45.516165 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 395/790] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:25:45 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:46.526808 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-07f524a0-00df-4a61-89c9-c9a18d03f0d9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:46.527735 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-07f524a0-00df-4a61-89c9-c9a18d03f0d9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:46.530224 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:46.535049 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-07f524a0-00df-4a61-89c9-c9a18d03f0d9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:46.535506 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-07f524a0-00df-4a61-89c9-c9a18d03f0d9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:46.536278 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-07f524a0-00df-4a61-89c9-c9a18d03f0d9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:46.537026 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-07f524a0-00df-4a61-89c9-c9a18d03f0d9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:46.565907 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-07f524a0-00df-4a61-89c9-c9a18d03f0d9 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043128 Jun 22 10:25:46.566465 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 396/791] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:25:46 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:25:46.638187 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c2cff4d6-b506-482a-b9dc-a17f11016f90 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:46.638728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c2cff4d6-b506-482a-b9dc-a17f11016f90 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:46.645677 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c2cff4d6-b506-482a-b9dc-a17f11016f90 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:46.646134 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c2cff4d6-b506-482a-b9dc-a17f11016f90 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:46.646920 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c2cff4d6-b506-482a-b9dc-a17f11016f90 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:46.647341 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c2cff4d6-b506-482a-b9dc-a17f11016f90 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:46.674390 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c2cff4d6-b506-482a-b9dc-a17f11016f90 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Going to try to terminate instance {{(pid=118327) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:25:47.169150 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c2cff4d6-b506-482a-b9dc-a17f11016f90 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 204 len: 0 microversion: 2.1 time: 0.534442 Jun 22 10:25:47.169739 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 396/792] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:25:46 2022] DELETE /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:25:47.178104 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2696c4dd-c522-4a04-bf14-2cd4d9a081ff tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:47.178704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2696c4dd-c522-4a04-bf14-2cd4d9a081ff tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:47.185405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2696c4dd-c522-4a04-bf14-2cd4d9a081ff tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:47.185845 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2696c4dd-c522-4a04-bf14-2cd4d9a081ff tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:47.186601 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2696c4dd-c522-4a04-bf14-2cd4d9a081ff tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:47.187031 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2696c4dd-c522-4a04-bf14-2cd4d9a081ff tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:47.316443 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2696c4dd-c522-4a04-bf14-2cd4d9a081ff tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:47.324228 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2696c4dd-c522-4a04-bf14-2cd4d9a081ff tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1689 microversion: 2.1 time: 0.150281 Jun 22 10:25:47.324796 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 397/793] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:47 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:48.342601 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f123690e-fe13-45ee-86a8-84b7dd6a7b70 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:48.343299 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f123690e-fe13-45ee-86a8-84b7dd6a7b70 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:48.350255 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f123690e-fe13-45ee-86a8-84b7dd6a7b70 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:48.350703 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f123690e-fe13-45ee-86a8-84b7dd6a7b70 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:48.351487 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f123690e-fe13-45ee-86a8-84b7dd6a7b70 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:48.351925 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f123690e-fe13-45ee-86a8-84b7dd6a7b70 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:48.488190 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f123690e-fe13-45ee-86a8-84b7dd6a7b70 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:48.495631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f123690e-fe13-45ee-86a8-84b7dd6a7b70 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1689 microversion: 2.1 time: 0.157884 Jun 22 10:25:48.496193 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 397/794] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:48 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:49.512214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-133ed1b4-092d-42d7-a209-884ef829bd38 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:49.512874 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-133ed1b4-092d-42d7-a209-884ef829bd38 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:49.519814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-133ed1b4-092d-42d7-a209-884ef829bd38 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:49.520273 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-133ed1b4-092d-42d7-a209-884ef829bd38 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:49.521082 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-133ed1b4-092d-42d7-a209-884ef829bd38 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:49.521522 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-133ed1b4-092d-42d7-a209-884ef829bd38 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:49.649095 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-133ed1b4-092d-42d7-a209-884ef829bd38 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:49.657095 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-133ed1b4-092d-42d7-a209-884ef829bd38 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1689 microversion: 2.1 time: 0.148683 Jun 22 10:25:49.657657 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 398/795] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:49 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:50.196532 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-eaa336ee-03db-4eca-82d9-9c56b25680db tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:50.197488 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-eaa336ee-03db-4eca-82d9-9c56b25680db tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:50.204507 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-eaa336ee-03db-4eca-82d9-9c56b25680db tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:50.205010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-eaa336ee-03db-4eca-82d9-9c56b25680db tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.205778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-eaa336ee-03db-4eca-82d9-9c56b25680db tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:50.206215 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-eaa336ee-03db-4eca-82d9-9c56b25680db tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.235927 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-eaa336ee-03db-4eca-82d9-9c56b25680db tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043076 Jun 22 10:25:50.236483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 398/796] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:25:50 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:25:50.295082 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2372ec7e-1b25-44e5-8cf1-c536d9576538 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:50.295577 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2372ec7e-1b25-44e5-8cf1-c536d9576538 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:50.301576 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2372ec7e-1b25-44e5-8cf1-c536d9576538 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:50.302026 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2372ec7e-1b25-44e5-8cf1-c536d9576538 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.302799 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2372ec7e-1b25-44e5-8cf1-c536d9576538 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:50.303237 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2372ec7e-1b25-44e5-8cf1-c536d9576538 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.327754 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2372ec7e-1b25-44e5-8cf1-c536d9576538 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:25:50.648605 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2372ec7e-1b25-44e5-8cf1-c536d9576538 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 204 len: 0 microversion: 2.1 time: 0.357670 Jun 22 10:25:50.649331 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 399/797] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:25:50 2022] DELETE /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:25:50.657859 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5b7f1025-cd24-40c7-ba35-8124bdbc2dae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:50.658466 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5b7f1025-cd24-40c7-ba35-8124bdbc2dae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:50.665125 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5b7f1025-cd24-40c7-ba35-8124bdbc2dae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:50.665580 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5b7f1025-cd24-40c7-ba35-8124bdbc2dae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.666356 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5b7f1025-cd24-40c7-ba35-8124bdbc2dae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:50.666795 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5b7f1025-cd24-40c7-ba35-8124bdbc2dae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.674917 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-103ba099-1b58-4661-90d1-26d2b19603eb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:50.675625 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-103ba099-1b58-4661-90d1-26d2b19603eb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:50.682330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-103ba099-1b58-4661-90d1-26d2b19603eb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:50.682330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-103ba099-1b58-4661-90d1-26d2b19603eb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.683112 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-103ba099-1b58-4661-90d1-26d2b19603eb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:50.683584 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-103ba099-1b58-4661-90d1-26d2b19603eb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.867267 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5b7f1025-cd24-40c7-ba35-8124bdbc2dae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:50.874115 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-103ba099-1b58-4661-90d1-26d2b19603eb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:50.875609 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5b7f1025-cd24-40c7-ba35-8124bdbc2dae tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1672 microversion: 2.1 time: 0.222029 Jun 22 10:25:50.876256 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 399/798] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:50 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1672 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:50.882303 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-103ba099-1b58-4661-90d1-26d2b19603eb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1689 microversion: 2.1 time: 0.211581 Jun 22 10:25:50.882883 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 400/799] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:50 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1689 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:25:51.892636 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e8bc12ea-b208-4d59-accb-9bb27f3679b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:51.893300 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e8bc12ea-b208-4d59-accb-9bb27f3679b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:51.899290 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-06ee4b8a-f93f-4d49-84d1-50defa0de25e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:51.902193 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-06ee4b8a-f93f-4d49-84d1-50defa0de25e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:51.902438 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e8bc12ea-b208-4d59-accb-9bb27f3679b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:51.902438 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e8bc12ea-b208-4d59-accb-9bb27f3679b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:51.902438 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e8bc12ea-b208-4d59-accb-9bb27f3679b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:51.902438 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e8bc12ea-b208-4d59-accb-9bb27f3679b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:51.907089 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06ee4b8a-f93f-4d49-84d1-50defa0de25e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:51.907547 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06ee4b8a-f93f-4d49-84d1-50defa0de25e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:51.908328 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06ee4b8a-f93f-4d49-84d1-50defa0de25e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:51.908766 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06ee4b8a-f93f-4d49-84d1-50defa0de25e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:52.104006 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-e8bc12ea-b208-4d59-accb-9bb27f3679b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:52.111895 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-06ee4b8a-f93f-4d49-84d1-50defa0de25e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:52.119171 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e8bc12ea-b208-4d59-accb-9bb27f3679b7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1672 microversion: 2.1 time: 0.230474 Jun 22 10:25:52.128878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 400/800] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:51 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1672 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:25:52.131120 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-06ee4b8a-f93f-4d49-84d1-50defa0de25e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1689 microversion: 2.1 time: 0.234580 Jun 22 10:25:52.131120 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 401/801] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:51 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1689 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:25:53.102982 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-33e45b2c-5c97-4755-83b9-b3fac60e6392 req-46666a17-79e2-48b4-bb7d-c1ec849bb3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6", "name": "network-vif-deleted", "tag": "c91bf175-3a15-4ba3-8e3a-92fa06cf2063"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:53.112458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-33e45b2c-5c97-4755-83b9-b3fac60e6392 req-46666a17-79e2-48b4-bb7d-c1ec849bb3d6 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:53.113006 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-33e45b2c-5c97-4755-83b9-b3fac60e6392 req-46666a17-79e2-48b4-bb7d-c1ec849bb3d6 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:53.124852 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-33e45b2c-5c97-4755-83b9-b3fac60e6392 req-46666a17-79e2-48b4-bb7d-c1ec849bb3d6 service nova] Creating event network-vif-deleted:c91bf175-3a15-4ba3-8e3a-92fa06cf2063 for instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 on hv-cinder-84327 Jun 22 10:25:53.131057 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-33e45b2c-5c97-4755-83b9-b3fac60e6392 req-46666a17-79e2-48b4-bb7d-c1ec849bb3d6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031093 Jun 22 10:25:53.135978 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f92d8f14-6acd-4ead-bf1b-5ae34bbbdaa7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:53.137201 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f92d8f14-6acd-4ead-bf1b-5ae34bbbdaa7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:53.144114 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 401/802] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:53.149513 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6d9e9861-4500-46cb-a6b5-c301a02cc103 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:53.150192 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6d9e9861-4500-46cb-a6b5-c301a02cc103 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:53.152904 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f92d8f14-6acd-4ead-bf1b-5ae34bbbdaa7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:53.153872 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f92d8f14-6acd-4ead-bf1b-5ae34bbbdaa7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:53.154652 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f92d8f14-6acd-4ead-bf1b-5ae34bbbdaa7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:53.155093 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f92d8f14-6acd-4ead-bf1b-5ae34bbbdaa7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:53.167476 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6d9e9861-4500-46cb-a6b5-c301a02cc103 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:53.168023 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6d9e9861-4500-46cb-a6b5-c301a02cc103 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:53.168689 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6d9e9861-4500-46cb-a6b5-c301a02cc103 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:53.170260 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6d9e9861-4500-46cb-a6b5-c301a02cc103 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:53.239692 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f92d8f14-6acd-4ead-bf1b-5ae34bbbdaa7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:53.253696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f92d8f14-6acd-4ead-bf1b-5ae34bbbdaa7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1604 microversion: 2.1 time: 0.117908 Jun 22 10:25:53.253696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 402/803] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:53 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1604 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:53.299769 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6d9e9861-4500-46cb-a6b5-c301a02cc103 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:53.307917 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6d9e9861-4500-46cb-a6b5-c301a02cc103 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1622 microversion: 2.1 time: 0.162497 Jun 22 10:25:53.308583 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 402/804] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:53 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1622 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:54.273411 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-cb41cd9a-2a11-427e-b772-c4d2bdad7bc0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:54.274875 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-cb41cd9a-2a11-427e-b772-c4d2bdad7bc0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:54.282214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cb41cd9a-2a11-427e-b772-c4d2bdad7bc0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:54.282939 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cb41cd9a-2a11-427e-b772-c4d2bdad7bc0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:54.283726 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cb41cd9a-2a11-427e-b772-c4d2bdad7bc0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:54.284161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cb41cd9a-2a11-427e-b772-c4d2bdad7bc0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:54.320005 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cb41cd9a-2a11-427e-b772-c4d2bdad7bc0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:54.321166 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cb41cd9a-2a11-427e-b772-c4d2bdad7bc0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:54.321572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-cb41cd9a-2a11-427e-b772-c4d2bdad7bc0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lazy-loading 'fault' on Instance uuid a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:25:54.326614 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-57401ff6-bb12-49a7-8a56-9504c597a6c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:54.328184 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-57401ff6-bb12-49a7-8a56-9504c597a6c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:54.335086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57401ff6-bb12-49a7-8a56-9504c597a6c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:54.342268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57401ff6-bb12-49a7-8a56-9504c597a6c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:54.342268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57401ff6-bb12-49a7-8a56-9504c597a6c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:54.342268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57401ff6-bb12-49a7-8a56-9504c597a6c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:54.378154 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57401ff6-bb12-49a7-8a56-9504c597a6c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:54.378800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57401ff6-bb12-49a7-8a56-9504c597a6c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:54.379398 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-57401ff6-bb12-49a7-8a56-9504c597a6c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lazy-loading 'fault' on Instance uuid 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:25:54.380807 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-cb41cd9a-2a11-427e-b772-c4d2bdad7bc0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:54.389989 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-cb41cd9a-2a11-427e-b772-c4d2bdad7bc0 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 200 len: 1327 microversion: 2.1 time: 0.124807 Jun 22 10:25:54.390668 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 403/805] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:54 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 1327 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:54.431771 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-57401ff6-bb12-49a7-8a56-9504c597a6c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:54.441738 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-57401ff6-bb12-49a7-8a56-9504c597a6c2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 200 len: 1336 microversion: 2.1 time: 0.120546 Jun 22 10:25:54.442632 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 403/806] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:54 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 1336 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:25:55.177163 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-8b346514-988d-413a-851c-1ce29bdcd3ab req-2a474bc4-66e8-472b-9d27-01274c20e686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5", "name": "network-vif-deleted", "tag": "54ad74cf-b62f-42ef-8cee-15d7aef7f8e7"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:55.186476 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-8b346514-988d-413a-851c-1ce29bdcd3ab req-2a474bc4-66e8-472b-9d27-01274c20e686 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:55.186917 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-8b346514-988d-413a-851c-1ce29bdcd3ab req-2a474bc4-66e8-472b-9d27-01274c20e686 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:55.200203 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-8b346514-988d-413a-851c-1ce29bdcd3ab req-2a474bc4-66e8-472b-9d27-01274c20e686 service nova] Creating event network-vif-deleted:54ad74cf-b62f-42ef-8cee-15d7aef7f8e7 for instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 on hv-cinder-84327 Jun 22 10:25:55.205850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-8b346514-988d-413a-851c-1ce29bdcd3ab req-2a474bc4-66e8-472b-9d27-01274c20e686 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032065 Jun 22 10:25:55.206528 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 404/807] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:55.408095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a9ac7e2d-d9ec-420d-bb7b-f0a2fd434a5d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:55.408658 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a9ac7e2d-d9ec-420d-bb7b-f0a2fd434a5d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:55.415336 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a9ac7e2d-d9ec-420d-bb7b-f0a2fd434a5d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:55.415782 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a9ac7e2d-d9ec-420d-bb7b-f0a2fd434a5d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:55.416537 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a9ac7e2d-d9ec-420d-bb7b-f0a2fd434a5d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:55.417009 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a9ac7e2d-d9ec-420d-bb7b-f0a2fd434a5d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:55.430577 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-a9ac7e2d-d9ec-420d-bb7b-f0a2fd434a5d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] HTTP exception thrown: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a9ac7e2d-d9ec-420d-bb7b-f0a2fd434a5d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Request method failure captured: Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 HTTP/1.1 Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisux58zGJ-1HFrwqomJB_HegERleKRTSv7ZcWOFhumgQHxnc2eyKDw_JRv9xfelSW-7u6wLOYgR_uqYuHTkuCJzXSaxZr62rYVQ30cZfePF-HAyfuekBsJZxq1ms36woZ-Wiw3LS27oLYYL_ZFNg0FVyvchVxB8JnXBZ23QhWKcl2ZsI Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 43383a4476d847f797dfb43fbfc66e42 Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:25:55.432195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:25:55.433638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43383a4476d847f797dfb43fbfc66e42", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:25:55.433638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:25:55.433638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 43383a4476d847f797dfb43fbfc66e42 Jun 22 10:25:55.433638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:25:55.433638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-AttachVolumeTestJSON-1325718796-project Jun 22 10:25:55.433638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:25:55.433638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:25:55.433638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 16265c4e556943369aa0cb3e961795bb Jun 22 10:25:55.433638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-AttachVolumeTestJSON-1325718796-project Jun 22 10:25:55.433638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:25:55.433638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:25:55.433638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': 'a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5'} Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:25:55.434429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:25:55.436119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:55.437670 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a9ac7e2d-d9ec-420d-bb7b-f0a2fd434a5d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Returning 404 to user: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:25:55.437670 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a9ac7e2d-d9ec-420d-bb7b-f0a2fd434a5d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 404 len: 111 microversion: 2.1 time: 0.029538 Jun 22 10:25:55.437670 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 404/808] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:55 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:25:55.443080 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-26ceb5a5-c572-461a-8f95-feda9e678523 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '.version_select at 0x7f021fc7b940>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:55.459363 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-76cdcec5-05e6-4fec-b1ff-5fb9cd21432e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:55.459969 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-76cdcec5-05e6-4fec-b1ff-5fb9cd21432e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:55.466398 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-76cdcec5-05e6-4fec-b1ff-5fb9cd21432e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:55.466850 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-76cdcec5-05e6-4fec-b1ff-5fb9cd21432e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:55.467600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-76cdcec5-05e6-4fec-b1ff-5fb9cd21432e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:55.468035 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-76cdcec5-05e6-4fec-b1ff-5fb9cd21432e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:55.482402 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-76cdcec5-05e6-4fec-b1ff-5fb9cd21432e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] HTTP exception thrown: Instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 could not be found. Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-76cdcec5-05e6-4fec-b1ff-5fb9cd21432e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Request method failure captured: Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 HTTP/1.1 Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisux0IeVehkqtNo7n7J7FM8HPVJHOjCuT4m0Ji2aSNkBVMCCn6SbSuTDB7CSpzKBIHPL8itk1MLGK3PBVVED-wqW1XGpxjrpnMahJuE-_foiUHqCo7_rUnQn9l6VFl_80qm7MInXFrtEQmwRBBty2huD9MJbF9_iRgsagV3uAZLCm1iA Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 30df978aece349c4baf14cc311f7b498 Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:25:55.483899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:25:55.485457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30df978aece349c4baf14cc311f7b498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_30df978aece349c4baf14cc311f7b498", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30df978aece349c4baf14cc311f7b498"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/30df978aece349c4baf14cc311f7b498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:25:55.485457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:25:55.485457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 30df978aece349c4baf14cc311f7b498 Jun 22 10:25:55.485457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:25:55.485457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-ServerRescueNegativeTestJSON-190891196-project Jun 22 10:25:55.485457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:25:55.485457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:25:55.485457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 425bf40bd45642a1aafeb65bdb9650af Jun 22 10:25:55.485457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-ServerRescueNegativeTestJSON-190891196-project Jun 22 10:25:55.485457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:25:55.485457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 could not be found. Jun 22 10:25:55.485457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6'} Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 could not be found. Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:25:55.486529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 could not be found. Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 could not be found. Jun 22 10:25:55.487946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:25:55.489664 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-76cdcec5-05e6-4fec-b1ff-5fb9cd21432e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Returning 404 to user: Instance 4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:25:55.489664 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-76cdcec5-05e6-4fec-b1ff-5fb9cd21432e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6" status: 404 len: 111 microversion: 2.1 time: 0.029928 Jun 22 10:25:55.489664 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 405/809] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:55 2022] GET /compute/v2.1/servers/4c37b4bb-99f9-4cdc-91d0-d8ebb4a75af6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:25:55.493323 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1758dc7a-6cfb-401d-ac80-edb3b9c3877a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '.version_select at 0x7f021faf8280>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:55.535679 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-26ceb5a5-c572-461a-8f95-feda9e678523 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547529637" status: 202 len: 0 microversion: 2.1 time: 0.096766 Jun 22 10:25:55.536256 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 405/810] 10.222.0.46 () {58 vars in 1220 bytes} [Wed Jun 22 10:25:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1547529637 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:25:55.638386 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1758dc7a-6cfb-401d-ac80-edb3b9c3877a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079997507" status: 202 len: 0 microversion: 2.1 time: 0.148380 Jun 22 10:25:55.638986 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 406/811] 10.222.0.46 () {58 vars in 1220 bytes} [Wed Jun 22 10:25:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1079997507 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:25:56.357666 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a3478ec5-be38-41e1-a6af-6c6a29443fcb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Action: 'create', calling method: .version_select at 0x7f021fc69160>, body: {"keypair": {"name": "tempest-keypair-767709485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxL2QMrvajP1e8tq8aDyg22ALHb/bT5dVAP8d1baAknTo61HD3US6Q4znMVf7hJ0UEDnS+HCo+Q+9OEG8PTm2HQPRmIhvnjQYCCihxjroLQRRnihBQ3nWeEfqTR7K5Y3g=="}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:56.372421 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-a3478ec5-be38-41e1-a6af-6c6a29443fcb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Getting quotas for project 43383a4476d847f797dfb43fbfc66e42. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:25:56.376337 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-a3478ec5-be38-41e1-a6af-6c6a29443fcb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Getting quotas for user 16265c4e556943369aa0cb3e961795bb and project 43383a4476d847f797dfb43fbfc66e42. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:25:56.547934 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a3478ec5-be38-41e1-a6af-6c6a29443fcb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.194217 Jun 22 10:25:56.548805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 406/812] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jun 22 10:25:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:59.153154 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a70b89e7-b622-4c8d-8dd3-08d982da20be tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:59.153759 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a70b89e7-b622-4c8d-8dd3-08d982da20be tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:59.161345 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a70b89e7-b622-4c8d-8dd3-08d982da20be tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:59.163897 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a70b89e7-b622-4c8d-8dd3-08d982da20be tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:59.163897 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a70b89e7-b622-4c8d-8dd3-08d982da20be tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:59.163897 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a70b89e7-b622-4c8d-8dd3-08d982da20be tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:59.182012 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:59.189983 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a70b89e7-b622-4c8d-8dd3-08d982da20be tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Going to try to terminate instance {{(pid=118327) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:25:59.271215 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6943a3fb-17ac-430d-bd69-30dd4deddccb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:59.275755 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6943a3fb-17ac-430d-bd69-30dd4deddccb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:59.280560 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6943a3fb-17ac-430d-bd69-30dd4deddccb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:59.281451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6943a3fb-17ac-430d-bd69-30dd4deddccb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:59.282450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6943a3fb-17ac-430d-bd69-30dd4deddccb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:59.283049 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6943a3fb-17ac-430d-bd69-30dd4deddccb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:59.311539 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:59.316456 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6943a3fb-17ac-430d-bd69-30dd4deddccb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:25:59.744747 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6943a3fb-17ac-430d-bd69-30dd4deddccb tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 204 len: 0 microversion: 2.1 time: 0.477334 Jun 22 10:25:59.745320 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 407/813] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:25:59 2022] DELETE /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 10:25:59.751817 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1323135503", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72f50f25-07f0-4518-92c4-2de857dd3884"}], "security_groups": [{"name": "tempest-securitygroup--1843138493"}], "key_name": "tempest-keypair-767709485", "user_data": "}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:59.794716 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a70b89e7-b622-4c8d-8dd3-08d982da20be tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 204 len: 0 microversion: 2.1 time: 0.645373 Jun 22 10:25:59.795303 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 407/814] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:25:59 2022] DELETE /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:25:59.800543 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a62d5715-5ab0-4baa-9b02-923ab6279f6d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:59.801278 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a62d5715-5ab0-4baa-9b02-923ab6279f6d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:59.807473 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a62d5715-5ab0-4baa-9b02-923ab6279f6d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:59.807918 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a62d5715-5ab0-4baa-9b02-923ab6279f6d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:59.808730 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a62d5715-5ab0-4baa-9b02-923ab6279f6d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:59.809205 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a62d5715-5ab0-4baa-9b02-923ab6279f6d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:59.913711 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.network.neutron [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] validate_networks() for [('72f50f25-07f0-4518-92c4-2de857dd3884', None, None, None, None, None)] {{(pid=118326) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:26:00.046431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a62d5715-5ab0-4baa-9b02-923ab6279f6d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:00.053934 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a62d5715-5ab0-4baa-9b02-923ab6279f6d tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1508 microversion: 2.1 time: 0.257507 Jun 22 10:26:00.054497 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 408/815] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:59 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1508 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:00.059105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-71881c5a-d966-4344-a92b-e865011eb335 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:00.059703 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-71881c5a-d966-4344-a92b-e865011eb335 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:00.070367 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71881c5a-d966-4344-a92b-e865011eb335 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:00.070367 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71881c5a-d966-4344-a92b-e865011eb335 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:00.070367 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71881c5a-d966-4344-a92b-e865011eb335 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:00.070367 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-71881c5a-d966-4344-a92b-e865011eb335 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:00.287788 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-71881c5a-d966-4344-a92b-e865011eb335 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:00.306415 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-71881c5a-d966-4344-a92b-e865011eb335 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1579 microversion: 2.1 time: 0.239973 Jun 22 10:26:00.306415 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 409/816] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:00 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1579 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:00.392957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Flavor limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:26:00.393425 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Image limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:26:00.393848 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Flavor pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:26:00.394255 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Image pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:26:00.394666 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:26:00.404294 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:00.405556 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:00.405556 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:00.405979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:00.422778 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Getting quotas for project 43383a4476d847f797dfb43fbfc66e42. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:26:00.426726 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Getting quotas for user 16265c4e556943369aa0cb3e961795bb and project 43383a4476d847f797dfb43fbfc66e42. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:26:00.438372 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Going to run 1 instances... {{(pid=118326) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:26:00.445615 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118326) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:26:00.649440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-536ea7d5-64b1-44e5-87af-8e8df830a724 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.902769 Jun 22 10:26:00.652789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 408/817] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:25:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:26:00.660923 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0f441a55-bf69-4b81-80f5-b827bc2fbe02 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:00.661993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0f441a55-bf69-4b81-80f5-b827bc2fbe02 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:00.716671 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0f441a55-bf69-4b81-80f5-b827bc2fbe02 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:00.725204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0f441a55-bf69-4b81-80f5-b827bc2fbe02 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1237 microversion: 2.1 time: 0.068093 Jun 22 10:26:00.725782 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 410/818] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:00 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:01.071126 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-31d00cf8-73a4-4b87-982c-25ed8be1fe42 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:01.071768 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-31d00cf8-73a4-4b87-982c-25ed8be1fe42 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:01.083454 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-31d00cf8-73a4-4b87-982c-25ed8be1fe42 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:01.083899 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-31d00cf8-73a4-4b87-982c-25ed8be1fe42 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:01.084702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-31d00cf8-73a4-4b87-982c-25ed8be1fe42 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:01.085169 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-31d00cf8-73a4-4b87-982c-25ed8be1fe42 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:01.222849 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-31d00cf8-73a4-4b87-982c-25ed8be1fe42 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:01.231006 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-31d00cf8-73a4-4b87-982c-25ed8be1fe42 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1508 microversion: 2.1 time: 0.163916 Jun 22 10:26:01.232001 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 409/819] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:01 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:01.313395 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-64e44cb1-7efb-42a9-bcfe-630713b8a660 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:01.314006 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-64e44cb1-7efb-42a9-bcfe-630713b8a660 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:01.321278 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-64e44cb1-7efb-42a9-bcfe-630713b8a660 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:01.322911 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-64e44cb1-7efb-42a9-bcfe-630713b8a660 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:01.322911 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-64e44cb1-7efb-42a9-bcfe-630713b8a660 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:01.322911 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-64e44cb1-7efb-42a9-bcfe-630713b8a660 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:01.454517 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-64e44cb1-7efb-42a9-bcfe-630713b8a660 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:01.462281 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-64e44cb1-7efb-42a9-bcfe-630713b8a660 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1579 microversion: 2.1 time: 0.153333 Jun 22 10:26:01.462861 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 411/820] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:01 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:01.742395 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0b5d1055-d725-4679-903a-83ba62a5fcfb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:01.743012 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0b5d1055-d725-4679-903a-83ba62a5fcfb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:01.749895 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0b5d1055-d725-4679-903a-83ba62a5fcfb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:01.753836 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0b5d1055-d725-4679-903a-83ba62a5fcfb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:01.753836 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0b5d1055-d725-4679-903a-83ba62a5fcfb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:01.753836 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0b5d1055-d725-4679-903a-83ba62a5fcfb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:01.818590 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0b5d1055-d725-4679-903a-83ba62a5fcfb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:01.826764 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0b5d1055-d725-4679-903a-83ba62a5fcfb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1241 microversion: 2.1 time: 0.088713 Jun 22 10:26:01.827338 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 410/821] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:01 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:02.249140 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-922c4716-ef64-4eca-b347-506e1724e58b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:02.249781 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-922c4716-ef64-4eca-b347-506e1724e58b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:02.256156 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-922c4716-ef64-4eca-b347-506e1724e58b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:02.256515 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-922c4716-ef64-4eca-b347-506e1724e58b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:02.257328 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-922c4716-ef64-4eca-b347-506e1724e58b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:02.257965 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-922c4716-ef64-4eca-b347-506e1724e58b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:02.409638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-922c4716-ef64-4eca-b347-506e1724e58b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:02.417734 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-922c4716-ef64-4eca-b347-506e1724e58b tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1508 microversion: 2.1 time: 0.173000 Jun 22 10:26:02.418310 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 412/822] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:02 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:02.479769 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f9ce5a1a-229e-44d1-8578-1593135e59e9 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:02.480444 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f9ce5a1a-229e-44d1-8578-1593135e59e9 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:02.488019 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f9ce5a1a-229e-44d1-8578-1593135e59e9 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:02.488966 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f9ce5a1a-229e-44d1-8578-1593135e59e9 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:02.489275 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f9ce5a1a-229e-44d1-8578-1593135e59e9 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:02.489898 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f9ce5a1a-229e-44d1-8578-1593135e59e9 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:02.584724 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-3120ecb5-ae0d-45b9-94d2-80c30c84c669 req-638806e7-5278-4b34-b53e-f982bd5f7974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2acd1a7-4078-4955-ab65-12d905064011", "name": "network-vif-deleted", "tag": "e9e20178-585d-42d5-a786-c8d8f9ddf6d7"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:02.594487 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-3120ecb5-ae0d-45b9-94d2-80c30c84c669 req-638806e7-5278-4b34-b53e-f982bd5f7974 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:02.595347 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-3120ecb5-ae0d-45b9-94d2-80c30c84c669 req-638806e7-5278-4b34-b53e-f982bd5f7974 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:02.608229 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-3120ecb5-ae0d-45b9-94d2-80c30c84c669 req-638806e7-5278-4b34-b53e-f982bd5f7974 service nova] Creating event network-vif-deleted:e9e20178-585d-42d5-a786-c8d8f9ddf6d7 for instance c2acd1a7-4078-4955-ab65-12d905064011 on hv-cinder-84327 Jun 22 10:26:02.613440 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-3120ecb5-ae0d-45b9-94d2-80c30c84c669 req-638806e7-5278-4b34-b53e-f982bd5f7974 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032388 Jun 22 10:26:02.614071 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 413/823] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:26:02.648456 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f9ce5a1a-229e-44d1-8578-1593135e59e9 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:02.659457 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f9ce5a1a-229e-44d1-8578-1593135e59e9 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1579 microversion: 2.1 time: 0.183746 Jun 22 10:26:02.660066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 411/824] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:02 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1579 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:02.844359 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-313f4739-9c48-430d-ab6a-6123b1bcff15 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:02.845103 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-313f4739-9c48-430d-ab6a-6123b1bcff15 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:02.851980 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-313f4739-9c48-430d-ab6a-6123b1bcff15 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:02.853412 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-313f4739-9c48-430d-ab6a-6123b1bcff15 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:02.853412 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-313f4739-9c48-430d-ab6a-6123b1bcff15 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:02.853617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-313f4739-9c48-430d-ab6a-6123b1bcff15 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:02.942047 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-313f4739-9c48-430d-ab6a-6123b1bcff15 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:02.956841 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-313f4739-9c48-430d-ab6a-6123b1bcff15 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1289 microversion: 2.1 time: 0.116627 Jun 22 10:26:02.966986 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 414/825] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:02 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1289 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:03.435559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8819b19b-c4f2-4095-bb89-8b5a1125436e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:03.436314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8819b19b-c4f2-4095-bb89-8b5a1125436e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:03.446239 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8819b19b-c4f2-4095-bb89-8b5a1125436e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:03.446772 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8819b19b-c4f2-4095-bb89-8b5a1125436e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:03.447573 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8819b19b-c4f2-4095-bb89-8b5a1125436e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:03.448018 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8819b19b-c4f2-4095-bb89-8b5a1125436e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:03.486686 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8819b19b-c4f2-4095-bb89-8b5a1125436e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:03.487138 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8819b19b-c4f2-4095-bb89-8b5a1125436e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:03.487592 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-8819b19b-c4f2-4095-bb89-8b5a1125436e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lazy-loading 'fault' on Instance uuid c2acd1a7-4078-4955-ab65-12d905064011 {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:26:03.532975 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8819b19b-c4f2-4095-bb89-8b5a1125436e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:03.541610 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8819b19b-c4f2-4095-bb89-8b5a1125436e tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 200 len: 1312 microversion: 2.1 time: 0.110528 Jun 22 10:26:03.543523 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 412/826] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:03 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:03.679752 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9008dadf-8127-45bb-866d-96e854d24b88 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:03.681103 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9008dadf-8127-45bb-866d-96e854d24b88 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:03.695202 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9008dadf-8127-45bb-866d-96e854d24b88 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:03.704180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9008dadf-8127-45bb-866d-96e854d24b88 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:03.704180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9008dadf-8127-45bb-866d-96e854d24b88 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:03.704180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9008dadf-8127-45bb-866d-96e854d24b88 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:03.767706 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9008dadf-8127-45bb-866d-96e854d24b88 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:03.776007 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9008dadf-8127-45bb-866d-96e854d24b88 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1225 microversion: 2.1 time: 0.103568 Jun 22 10:26:03.777686 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 415/827] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:03 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:03.974604 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ebabf32e-a524-43ad-9d40-e47824b13abc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:03.975215 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ebabf32e-a524-43ad-9d40-e47824b13abc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:03.982820 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ebabf32e-a524-43ad-9d40-e47824b13abc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:03.983466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ebabf32e-a524-43ad-9d40-e47824b13abc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:03.984415 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ebabf32e-a524-43ad-9d40-e47824b13abc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:03.984857 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ebabf32e-a524-43ad-9d40-e47824b13abc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:04.053992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ebabf32e-a524-43ad-9d40-e47824b13abc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:04.061728 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ebabf32e-a524-43ad-9d40-e47824b13abc tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1295 microversion: 2.1 time: 0.091081 Jun 22 10:26:04.062303 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 413/828] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:03 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:04.559755 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bb7d663a-24a8-4452-9032-c62c5b589fd2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:04.560618 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bb7d663a-24a8-4452-9032-c62c5b589fd2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: c2acd1a7-4078-4955-ab65-12d905064011] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:04.566880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bb7d663a-24a8-4452-9032-c62c5b589fd2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:04.567431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bb7d663a-24a8-4452-9032-c62c5b589fd2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:04.568532 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bb7d663a-24a8-4452-9032-c62c5b589fd2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:04.569066 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bb7d663a-24a8-4452-9032-c62c5b589fd2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:04.583962 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-bb7d663a-24a8-4452-9032-c62c5b589fd2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] HTTP exception thrown: Instance c2acd1a7-4078-4955-ab65-12d905064011 could not be found. Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bb7d663a-24a8-4452-9032-c62c5b589fd2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Request method failure captured: Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 HTTP/1.1 Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisux0IeVehkqtNo7n7J7FM8HPVJHOjCuT4m0Ji2aSNkBVMCCn6SbSuTDB7CSpzKBIHPL8itk1MLGK3PBVVED-wqW1XGpxjrpnMahJuE-_foiUHqCo7_rUnQn9l6VFl_80qm7MInXFrtEQmwRBBty2huD9MJbF9_iRgsagV3uAZLCm1iA Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 30df978aece349c4baf14cc311f7b498 Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:26:04.585807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:26:04.592967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30df978aece349c4baf14cc311f7b498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_30df978aece349c4baf14cc311f7b498", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30df978aece349c4baf14cc311f7b498"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/30df978aece349c4baf14cc311f7b498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:26:04.592967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:26:04.592967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 30df978aece349c4baf14cc311f7b498 Jun 22 10:26:04.592967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:26:04.592967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-ServerRescueNegativeTestJSON-190891196-project Jun 22 10:26:04.592967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:26:04.592967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:26:04.592967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 425bf40bd45642a1aafeb65bdb9650af Jun 22 10:26:04.592967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-ServerRescueNegativeTestJSON-190891196-project Jun 22 10:26:04.592967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:26:04.592967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance c2acd1a7-4078-4955-ab65-12d905064011 could not be found. Jun 22 10:26:04.592967 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': 'c2acd1a7-4078-4955-ab65-12d905064011'} Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2acd1a7-4078-4955-ab65-12d905064011 could not be found. Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:26:04.596908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2acd1a7-4078-4955-ab65-12d905064011 could not be found. Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2acd1a7-4078-4955-ab65-12d905064011 could not be found. Jun 22 10:26:04.599522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:04.600794 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bb7d663a-24a8-4452-9032-c62c5b589fd2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Returning 404 to user: Instance c2acd1a7-4078-4955-ab65-12d905064011 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:26:04.600794 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bb7d663a-24a8-4452-9032-c62c5b589fd2 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011" status: 404 len: 111 microversion: 2.1 time: 0.031517 Jun 22 10:26:04.600794 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 416/829] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:04 2022] GET /compute/v2.1/servers/c2acd1a7-4078-4955-ab65-12d905064011 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:26:04.601079 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-38ef4f22-8dfd-473a-a355-587248242395 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:04.601079 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-38ef4f22-8dfd-473a-a355-587248242395 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:04.604394 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38ef4f22-8dfd-473a-a355-587248242395 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:04.605197 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38ef4f22-8dfd-473a-a355-587248242395 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:04.605594 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38ef4f22-8dfd-473a-a355-587248242395 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:04.606089 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38ef4f22-8dfd-473a-a355-587248242395 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:04.633236 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-38ef4f22-8dfd-473a-a355-587248242395 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:26:04.636154 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-85de0e35-60fb-4fa1-8c98-a2a01ffc9e22 req-3063f4ee-ade5-4dc7-b849-3d9fbebc7e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da7b015-3aba-44c4-bcc3-3f90cb093d11", "name": "network-vif-deleted", "tag": "fd686c54-9ac5-4c30-b37a-16a0f75b9906"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:04.654037 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-85de0e35-60fb-4fa1-8c98-a2a01ffc9e22 req-3063f4ee-ade5-4dc7-b849-3d9fbebc7e94 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:04.654037 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-85de0e35-60fb-4fa1-8c98-a2a01ffc9e22 req-3063f4ee-ade5-4dc7-b849-3d9fbebc7e94 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:04.679605 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-85de0e35-60fb-4fa1-8c98-a2a01ffc9e22 req-3063f4ee-ade5-4dc7-b849-3d9fbebc7e94 service nova] Creating event network-vif-deleted:fd686c54-9ac5-4c30-b37a-16a0f75b9906 for instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 on hv-cinder-84327 Jun 22 10:26:04.685783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-85de0e35-60fb-4fa1-8c98-a2a01ffc9e22 req-3063f4ee-ade5-4dc7-b849-3d9fbebc7e94 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057092 Jun 22 10:26:04.687906 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 417/830] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:26:04.794111 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5da6de4a-d237-409b-a379-b08d0857e1a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:04.795014 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5da6de4a-d237-409b-a379-b08d0857e1a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:04.802110 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5da6de4a-d237-409b-a379-b08d0857e1a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:04.802569 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5da6de4a-d237-409b-a379-b08d0857e1a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:04.803336 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5da6de4a-d237-409b-a379-b08d0857e1a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:04.803770 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5da6de4a-d237-409b-a379-b08d0857e1a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:04.836590 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5da6de4a-d237-409b-a379-b08d0857e1a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:04.837066 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5da6de4a-d237-409b-a379-b08d0857e1a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:04.837530 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-5da6de4a-d237-409b-a379-b08d0857e1a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lazy-loading 'fault' on Instance uuid 8da7b015-3aba-44c4-bcc3-3f90cb093d11 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:26:04.891776 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5da6de4a-d237-409b-a379-b08d0857e1a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:04.903514 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5da6de4a-d237-409b-a379-b08d0857e1a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 200 len: 1184 microversion: 2.1 time: 0.113822 Jun 22 10:26:04.909336 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 418/831] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:04 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 1184 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:04.984734 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-38ef4f22-8dfd-473a-a355-587248242395 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "DELETE /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 204 len: 0 microversion: 2.1 time: 0.391707 Jun 22 10:26:04.994746 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 414/832] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:26:04 2022] DELETE /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:26:04.995923 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2e435341-f021-46dd-8804-558822d57402 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:04.996634 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2e435341-f021-46dd-8804-558822d57402 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:05.011621 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2e435341-f021-46dd-8804-558822d57402 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:05.012195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2e435341-f021-46dd-8804-558822d57402 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:05.013970 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2e435341-f021-46dd-8804-558822d57402 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:05.014494 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2e435341-f021-46dd-8804-558822d57402 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:05.079544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ee261a9d-a4b7-4158-8e24-a8cb4a247a67 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:05.080259 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ee261a9d-a4b7-4158-8e24-a8cb4a247a67 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:05.097823 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ee261a9d-a4b7-4158-8e24-a8cb4a247a67 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:05.097823 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ee261a9d-a4b7-4158-8e24-a8cb4a247a67 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:05.097823 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ee261a9d-a4b7-4158-8e24-a8cb4a247a67 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:05.097823 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ee261a9d-a4b7-4158-8e24-a8cb4a247a67 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:05.223802 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2e435341-f021-46dd-8804-558822d57402 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:05.234498 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2e435341-f021-46dd-8804-558822d57402 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.243402 Jun 22 10:26:05.235881 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 419/833] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:04 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:05.270497 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ee261a9d-a4b7-4158-8e24-a8cb4a247a67 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:05.278893 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ee261a9d-a4b7-4158-8e24-a8cb4a247a67 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1363 microversion: 2.1 time: 0.203570 Jun 22 10:26:05.279481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 415/834] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:05 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:05.926076 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8e8f97fb-b057-4567-ae14-8bcaf8917791 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:05.926607 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8e8f97fb-b057-4567-ae14-8bcaf8917791 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:05.933291 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8e8f97fb-b057-4567-ae14-8bcaf8917791 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:05.933739 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8e8f97fb-b057-4567-ae14-8bcaf8917791 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:05.934509 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8e8f97fb-b057-4567-ae14-8bcaf8917791 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:05.935280 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8e8f97fb-b057-4567-ae14-8bcaf8917791 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:05.948856 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-8e8f97fb-b057-4567-ae14-8bcaf8917791 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] HTTP exception thrown: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8e8f97fb-b057-4567-ae14-8bcaf8917791 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Request method failure captured: Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 HTTP/1.1 Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu1SXkTD99ntCW7FdlVONdMvVVwVQrqDZmj3a15AnY-hj_f-HmXLVtYjT7EASpWcDlruxNjxfkhIsVpDtaszBvFoPzKZNJ1gnyaMLWiCF7aO_qawYM7irc4hKjcY81If9b-z6WEZwH_H2sTieQwGG26qBmmSznj27TQ47CHtuFKZ23M Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: abd71b49f6d9403b8cea1fd9e7680ffb Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-TestVolumeBootPattern-66661210 Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:26:05.951060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:26:05.952567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_abd71b49f6d9403b8cea1fd9e7680ffb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:26:05.952567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-TestVolumeBootPattern-66661210 Jun 22 10:26:05.952567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: abd71b49f6d9403b8cea1fd9e7680ffb Jun 22 10:26:05.952567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-TestVolumeBootPattern-66661210 Jun 22 10:26:05.952567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-TestVolumeBootPattern-66661210-project Jun 22 10:26:05.952567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:26:05.952567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:26:05.952567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 401fdd54d8a143a892fd2d2407a78bc5 Jun 22 10:26:05.952567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-TestVolumeBootPattern-66661210-project Jun 22 10:26:05.952567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:26:05.952567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:26:05.952567 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '8da7b015-3aba-44c4-bcc3-3f90cb093d11'} Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:26:05.953572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:26:05.955032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:05.956350 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8e8f97fb-b057-4567-ae14-8bcaf8917791 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Returning 404 to user: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:26:05.956350 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-8e8f97fb-b057-4567-ae14-8bcaf8917791 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 404 len: 111 microversion: 2.1 time: 0.030383 Jun 22 10:26:05.956350 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 420/835] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:05 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:26:05.999264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-355161958", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-861565459", "security_groups": [{"name": "tempest-secgroup-smoke-1809832332"}], "block_device_mapping_v2": [{"uuid": "94bcee82-398a-417f-a2ff-972b52654b54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d0645bff-6cba-4d07-864e-88eb84ff97aa"}]}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:06.112260 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.network.neutron [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] validate_networks() for [('d0645bff-6cba-4d07-864e-88eb84ff97aa', None, None, None, None, None)] {{(pid=118326) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:26:06.253170 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1b6b2e5a-b17c-4dbc-8b53-17d9bd8a9b35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:06.253804 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1b6b2e5a-b17c-4dbc-8b53-17d9bd8a9b35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:06.260244 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1b6b2e5a-b17c-4dbc-8b53-17d9bd8a9b35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:06.260699 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1b6b2e5a-b17c-4dbc-8b53-17d9bd8a9b35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:06.261744 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1b6b2e5a-b17c-4dbc-8b53-17d9bd8a9b35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:06.263132 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1b6b2e5a-b17c-4dbc-8b53-17d9bd8a9b35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:06.568180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1b6b2e5a-b17c-4dbc-8b53-17d9bd8a9b35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:06.579642 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1b6b2e5a-b17c-4dbc-8b53-17d9bd8a9b35 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.330573 Jun 22 10:26:06.580459 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 421/836] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:06 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:06.589185 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ab961bd8-49e6-482d-b4f2-903dd51184f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:06.589803 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ab961bd8-49e6-482d-b4f2-903dd51184f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:06.596148 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab961bd8-49e6-482d-b4f2-903dd51184f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:06.597086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab961bd8-49e6-482d-b4f2-903dd51184f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:06.597850 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab961bd8-49e6-482d-b4f2-903dd51184f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:06.598285 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab961bd8-49e6-482d-b4f2-903dd51184f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:06.823723 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ab961bd8-49e6-482d-b4f2-903dd51184f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:06.831862 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ab961bd8-49e6-482d-b4f2-903dd51184f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1363 microversion: 2.1 time: 0.250588 Jun 22 10:26:06.841188 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 422/837] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:06 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:06.841188 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-0d86b057-54fc-48d2-a3a1-e492424fd893 req-eef07683-7068-483e-b5e4-257ff7fb10cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9708aae-3c6d-424c-b082-97d46349a712", "tag": "f6899223-0cb6-4972-ae2f-846f84786e67"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:06.845890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-0d86b057-54fc-48d2-a3a1-e492424fd893 req-eef07683-7068-483e-b5e4-257ff7fb10cf service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:06.846501 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-0d86b057-54fc-48d2-a3a1-e492424fd893 req-eef07683-7068-483e-b5e4-257ff7fb10cf service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:06.858887 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-0d86b057-54fc-48d2-a3a1-e492424fd893 req-eef07683-7068-483e-b5e4-257ff7fb10cf service nova] Creating event network-changed:f6899223-0cb6-4972-ae2f-846f84786e67 for instance b9708aae-3c6d-424c-b082-97d46349a712 on hv-cinder-84327 Jun 22 10:26:06.864174 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-0d86b057-54fc-48d2-a3a1-e492424fd893 req-eef07683-7068-483e-b5e4-257ff7fb10cf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030300 Jun 22 10:26:06.865005 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 423/838] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:06.894696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Flavor limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:26:06.895115 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Image limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:26:06.895582 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Flavor pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:26:06.895988 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Image pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:26:06.896389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:26:06.905933 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:06.906373 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:06.907155 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:06.907581 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:06.924402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Getting quotas for project abd71b49f6d9403b8cea1fd9e7680ffb. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:26:06.928248 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Getting quotas for user 401fdd54d8a143a892fd2d2407a78bc5 and project abd71b49f6d9403b8cea1fd9e7680ffb. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:26:06.930575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:06.987045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Going to run 1 instances... {{(pid=118326) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:26:06.988314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94bcee82-398a-417f-a2ff-972b52654b54',volume_size=None,volume_type=None)] {{(pid=118326) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:26:07.479137 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4dd4fff0-ab68-4fa2-9911-6e8824b27b30 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.483628 Jun 22 10:26:07.479832 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 416/839] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:26:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:26:07.490550 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-72ddeeea-2af3-424a-986a-4c3d0d49f92a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:07.491242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-72ddeeea-2af3-424a-986a-4c3d0d49f92a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:07.550146 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-72ddeeea-2af3-424a-986a-4c3d0d49f92a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:07.557024 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-72ddeeea-2af3-424a-986a-4c3d0d49f92a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1093 microversion: 2.1 time: 0.070952 Jun 22 10:26:07.557636 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 424/840] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:07 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:07.597723 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1cd41635-cb45-4a87-b1fc-ec478e99dd8a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:07.598325 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1cd41635-cb45-4a87-b1fc-ec478e99dd8a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:07.605229 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1cd41635-cb45-4a87-b1fc-ec478e99dd8a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:07.605672 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1cd41635-cb45-4a87-b1fc-ec478e99dd8a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:07.606855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1cd41635-cb45-4a87-b1fc-ec478e99dd8a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:07.606855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1cd41635-cb45-4a87-b1fc-ec478e99dd8a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:07.742222 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1cd41635-cb45-4a87-b1fc-ec478e99dd8a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:07.750378 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1cd41635-cb45-4a87-b1fc-ec478e99dd8a tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.156515 Jun 22 10:26:07.750946 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 417/841] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:07 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:07.848901 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-73bc6ce2-0400-4177-a41d-66dc16aef9aa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:07.849430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-73bc6ce2-0400-4177-a41d-66dc16aef9aa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:07.856185 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-73bc6ce2-0400-4177-a41d-66dc16aef9aa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:07.856637 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-73bc6ce2-0400-4177-a41d-66dc16aef9aa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:07.857431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-73bc6ce2-0400-4177-a41d-66dc16aef9aa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:07.857871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-73bc6ce2-0400-4177-a41d-66dc16aef9aa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:07.988095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-73bc6ce2-0400-4177-a41d-66dc16aef9aa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:07.995566 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-73bc6ce2-0400-4177-a41d-66dc16aef9aa tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1363 microversion: 2.1 time: 0.150644 Jun 22 10:26:07.996124 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 425/842] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:07 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:08.573786 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b2b9384e-e4f1-455b-8ff8-f4c49d1f81d1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:08.574392 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b2b9384e-e4f1-455b-8ff8-f4c49d1f81d1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:08.581392 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b2b9384e-e4f1-455b-8ff8-f4c49d1f81d1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:08.581836 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b2b9384e-e4f1-455b-8ff8-f4c49d1f81d1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:08.582628 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b2b9384e-e4f1-455b-8ff8-f4c49d1f81d1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:08.583096 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b2b9384e-e4f1-455b-8ff8-f4c49d1f81d1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:08.651332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b2b9384e-e4f1-455b-8ff8-f4c49d1f81d1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:08.659583 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b2b9384e-e4f1-455b-8ff8-f4c49d1f81d1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1143 microversion: 2.1 time: 0.089573 Jun 22 10:26:08.660168 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 418/843] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:08 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:08.767663 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c5c0923a-2b41-40de-8f2c-c5c280d5fc98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:08.768263 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c5c0923a-2b41-40de-8f2c-c5c280d5fc98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:08.774758 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5c0923a-2b41-40de-8f2c-c5c280d5fc98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:08.775199 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5c0923a-2b41-40de-8f2c-c5c280d5fc98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:08.775949 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5c0923a-2b41-40de-8f2c-c5c280d5fc98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:08.776376 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c5c0923a-2b41-40de-8f2c-c5c280d5fc98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:08.910493 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c5c0923a-2b41-40de-8f2c-c5c280d5fc98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:08.918384 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c5c0923a-2b41-40de-8f2c-c5c280d5fc98 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1522 microversion: 2.1 time: 0.154601 Jun 22 10:26:08.919461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 426/844] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:08 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:09.013715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c4f2fd7a-444f-4e92-abda-b6fffb283b69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:09.014504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c4f2fd7a-444f-4e92-abda-b6fffb283b69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:09.021047 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c4f2fd7a-444f-4e92-abda-b6fffb283b69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:09.021500 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c4f2fd7a-444f-4e92-abda-b6fffb283b69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:09.022489 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c4f2fd7a-444f-4e92-abda-b6fffb283b69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:09.022796 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c4f2fd7a-444f-4e92-abda-b6fffb283b69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:09.160988 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c4f2fd7a-444f-4e92-abda-b6fffb283b69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:09.170874 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c4f2fd7a-444f-4e92-abda-b6fffb283b69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1363 microversion: 2.1 time: 0.161793 Jun 22 10:26:09.172779 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 419/845] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:09 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:09.677535 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-675ce852-4cc2-441c-89d1-9bcf1c92ff34 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:09.678358 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-675ce852-4cc2-441c-89d1-9bcf1c92ff34 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:09.688481 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-675ce852-4cc2-441c-89d1-9bcf1c92ff34 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:09.689000 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-675ce852-4cc2-441c-89d1-9bcf1c92ff34 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:09.689805 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-675ce852-4cc2-441c-89d1-9bcf1c92ff34 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:09.690247 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-675ce852-4cc2-441c-89d1-9bcf1c92ff34 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:09.718690 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:09.768413 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-675ce852-4cc2-441c-89d1-9bcf1c92ff34 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:09.776830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-675ce852-4cc2-441c-89d1-9bcf1c92ff34 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1191 microversion: 2.1 time: 0.103115 Jun 22 10:26:09.777414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 427/846] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:09 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1191 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:09.936548 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b2ea4af7-35db-4652-86c9-80aa54c3aee7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:09.937365 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b2ea4af7-35db-4652-86c9-80aa54c3aee7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:09.946626 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b2ea4af7-35db-4652-86c9-80aa54c3aee7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:09.947380 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b2ea4af7-35db-4652-86c9-80aa54c3aee7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:09.948350 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b2ea4af7-35db-4652-86c9-80aa54c3aee7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:09.948998 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b2ea4af7-35db-4652-86c9-80aa54c3aee7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:10.034584 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b2ea4af7-35db-4652-86c9-80aa54c3aee7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:10.037942 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-657e8f68-6a0b-410d-8663-f5c2e6fd244d req-8522c35b-2f56-4c8c-847e-7c89c70da173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398fb416-b4c6-4b43-80be-683e1a41721b", "name": "network-vif-deleted", "tag": "5e03fdc7-3edb-469a-871f-db5cfb33c5e3"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:10.046360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b2ea4af7-35db-4652-86c9-80aa54c3aee7 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1480 microversion: 2.1 time: 0.113371 Jun 22 10:26:10.047743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 420/847] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:09 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1480 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:10.062853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-657e8f68-6a0b-410d-8663-f5c2e6fd244d req-8522c35b-2f56-4c8c-847e-7c89c70da173 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:10.064195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-657e8f68-6a0b-410d-8663-f5c2e6fd244d req-8522c35b-2f56-4c8c-847e-7c89c70da173 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:10.078729 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-657e8f68-6a0b-410d-8663-f5c2e6fd244d req-8522c35b-2f56-4c8c-847e-7c89c70da173 service nova] Creating event network-vif-deleted:5e03fdc7-3edb-469a-871f-db5cfb33c5e3 for instance 398fb416-b4c6-4b43-80be-683e1a41721b on hv-cinder-84327 Jun 22 10:26:10.084575 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-657e8f68-6a0b-410d-8663-f5c2e6fd244d req-8522c35b-2f56-4c8c-847e-7c89c70da173 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052265 Jun 22 10:26:10.085892 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 428/848] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:26:10.190268 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f8e48072-2db9-4c9c-ba09-82d1081cee4f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:10.191147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f8e48072-2db9-4c9c-ba09-82d1081cee4f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:10.198463 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f8e48072-2db9-4c9c-ba09-82d1081cee4f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:10.199356 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f8e48072-2db9-4c9c-ba09-82d1081cee4f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:10.200891 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f8e48072-2db9-4c9c-ba09-82d1081cee4f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:10.201493 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f8e48072-2db9-4c9c-ba09-82d1081cee4f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:10.339032 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f8e48072-2db9-4c9c-ba09-82d1081cee4f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:10.342481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:10.346919 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f8e48072-2db9-4c9c-ba09-82d1081cee4f tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1363 microversion: 2.1 time: 0.160971 Jun 22 10:26:10.347494 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 421/849] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:10 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:10.795774 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-794fe30c-ce18-4d01-aa9b-c2e21c5320e5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:10.797490 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-794fe30c-ce18-4d01-aa9b-c2e21c5320e5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:10.813130 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-794fe30c-ce18-4d01-aa9b-c2e21c5320e5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:10.813130 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-794fe30c-ce18-4d01-aa9b-c2e21c5320e5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:10.813130 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-794fe30c-ce18-4d01-aa9b-c2e21c5320e5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:10.813130 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-794fe30c-ce18-4d01-aa9b-c2e21c5320e5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:10.873756 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-794fe30c-ce18-4d01-aa9b-c2e21c5320e5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:10.881432 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-794fe30c-ce18-4d01-aa9b-c2e21c5320e5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1209 microversion: 2.1 time: 0.091080 Jun 22 10:26:10.882001 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 429/850] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:10 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:11.063827 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a67b0346-6716-414f-bdcd-f1c1721509c3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:11.065289 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a67b0346-6716-414f-bdcd-f1c1721509c3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:11.073002 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a67b0346-6716-414f-bdcd-f1c1721509c3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:11.073710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a67b0346-6716-414f-bdcd-f1c1721509c3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:11.074493 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a67b0346-6716-414f-bdcd-f1c1721509c3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:11.075589 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a67b0346-6716-414f-bdcd-f1c1721509c3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:11.110661 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a67b0346-6716-414f-bdcd-f1c1721509c3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:11.111215 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a67b0346-6716-414f-bdcd-f1c1721509c3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:11.111876 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-a67b0346-6716-414f-bdcd-f1c1721509c3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lazy-loading 'fault' on Instance uuid 398fb416-b4c6-4b43-80be-683e1a41721b {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:26:11.154855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a67b0346-6716-414f-bdcd-f1c1721509c3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '425bf40bd45642a1aafeb65bdb9650af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30df978aece349c4baf14cc311f7b498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:11.162939 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a67b0346-6716-414f-bdcd-f1c1721509c3 tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 200 len: 1312 microversion: 2.1 time: 0.103135 Jun 22 10:26:11.163526 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 422/851] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:11 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:11.372938 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f3bb31ae-6866-4949-a997-1cc3d384f2bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:11.372938 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f3bb31ae-6866-4949-a997-1cc3d384f2bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:11.372938 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f3bb31ae-6866-4949-a997-1cc3d384f2bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:11.372938 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f3bb31ae-6866-4949-a997-1cc3d384f2bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:11.373357 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f3bb31ae-6866-4949-a997-1cc3d384f2bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:11.373357 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f3bb31ae-6866-4949-a997-1cc3d384f2bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:11.519190 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f3bb31ae-6866-4949-a997-1cc3d384f2bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:11.531763 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f3bb31ae-6866-4949-a997-1cc3d384f2bf tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1363 microversion: 2.1 time: 0.170886 Jun 22 10:26:11.533154 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 430/852] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:11 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:11.899026 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c5a98e17-9424-4a00-bfbc-812bcee06cb8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:11.899641 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c5a98e17-9424-4a00-bfbc-812bcee06cb8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:11.907133 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c5a98e17-9424-4a00-bfbc-812bcee06cb8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:11.907638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c5a98e17-9424-4a00-bfbc-812bcee06cb8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:11.908464 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c5a98e17-9424-4a00-bfbc-812bcee06cb8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:11.908860 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c5a98e17-9424-4a00-bfbc-812bcee06cb8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:12.049327 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c5a98e17-9424-4a00-bfbc-812bcee06cb8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:12.056988 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c5a98e17-9424-4a00-bfbc-812bcee06cb8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1277 microversion: 2.1 time: 0.161894 Jun 22 10:26:12.057827 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 423/853] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:11 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:12.180425 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b6a73c70-e210-4000-bca1-637cede97acd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:12.182306 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b6a73c70-e210-4000-bca1-637cede97acd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] [instance: 398fb416-b4c6-4b43-80be-683e1a41721b] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:12.192891 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-a09e72d0-6ca3-4479-94f2-80f81828bcf0 req-91f19d5e-e337-465e-989b-d243f93787ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9708aae-3c6d-424c-b082-97d46349a712", "name": "network-vif-plugged", "status": "completed", "tag": "f6899223-0cb6-4972-ae2f-846f84786e67"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:12.196015 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b6a73c70-e210-4000-bca1-637cede97acd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:12.201909 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b6a73c70-e210-4000-bca1-637cede97acd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:12.202831 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b6a73c70-e210-4000-bca1-637cede97acd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:12.203344 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b6a73c70-e210-4000-bca1-637cede97acd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:12.211062 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-a09e72d0-6ca3-4479-94f2-80f81828bcf0 req-91f19d5e-e337-465e-989b-d243f93787ec service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:12.226496 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-a09e72d0-6ca3-4479-94f2-80f81828bcf0 req-91f19d5e-e337-465e-989b-d243f93787ec service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:12.230507 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-b6a73c70-e210-4000-bca1-637cede97acd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] HTTP exception thrown: Instance 398fb416-b4c6-4b43-80be-683e1a41721b could not be found. Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b6a73c70-e210-4000-bca1-637cede97acd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Request method failure captured: Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b HTTP/1.1 Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisux0IeVehkqtNo7n7J7FM8HPVJHOjCuT4m0Ji2aSNkBVMCCn6SbSuTDB7CSpzKBIHPL8itk1MLGK3PBVVED-wqW1XGpxjrpnMahJuE-_foiUHqCo7_rUnQn9l6VFl_80qm7MInXFrtEQmwRBBty2huD9MJbF9_iRgsagV3uAZLCm1iA Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 30df978aece349c4baf14cc311f7b498 Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:26:12.232764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:26:12.234362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30df978aece349c4baf14cc311f7b498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_30df978aece349c4baf14cc311f7b498", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/30df978aece349c4baf14cc311f7b498"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/30df978aece349c4baf14cc311f7b498"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:26:12.234362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:26:12.234362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 30df978aece349c4baf14cc311f7b498 Jun 22 10:26:12.234362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-190891196 Jun 22 10:26:12.234362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-ServerRescueNegativeTestJSON-190891196-project Jun 22 10:26:12.234362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:26:12.234362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:26:12.234362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 425bf40bd45642a1aafeb65bdb9650af Jun 22 10:26:12.234362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-ServerRescueNegativeTestJSON-190891196-project Jun 22 10:26:12.234362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:26:12.234362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 398fb416-b4c6-4b43-80be-683e1a41721b could not be found. Jun 22 10:26:12.234362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '398fb416-b4c6-4b43-80be-683e1a41721b'} Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 398fb416-b4c6-4b43-80be-683e1a41721b could not be found. Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:26:12.235160 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398fb416-b4c6-4b43-80be-683e1a41721b could not be found. Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398fb416-b4c6-4b43-80be-683e1a41721b could not be found. Jun 22 10:26:12.236465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:12.238629 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b6a73c70-e210-4000-bca1-637cede97acd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] Returning 404 to user: Instance 398fb416-b4c6-4b43-80be-683e1a41721b could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:26:12.238860 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-a09e72d0-6ca3-4479-94f2-80f81828bcf0 req-91f19d5e-e337-465e-989b-d243f93787ec service nova] Creating event network-vif-plugged:f6899223-0cb6-4972-ae2f-846f84786e67 for instance b9708aae-3c6d-424c-b082-97d46349a712 on hv-cinder-84327 Jun 22 10:26:12.239008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b6a73c70-e210-4000-bca1-637cede97acd tempest-ServerRescueNegativeTestJSON-190891196 tempest-ServerRescueNegativeTestJSON-190891196-project] 10.222.0.46 "GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b" status: 404 len: 111 microversion: 2.1 time: 0.060357 Jun 22 10:26:12.239008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 431/854] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:12 2022] GET /compute/v2.1/servers/398fb416-b4c6-4b43-80be-683e1a41721b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:26:12.245602 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-a09e72d0-6ca3-4479-94f2-80f81828bcf0 req-91f19d5e-e337-465e-989b-d243f93787ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056777 Jun 22 10:26:12.246992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 424/855] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:26:12.549542 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bca8e89c-0a15-42ae-9328-080ca44e1ce6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:12.550364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bca8e89c-0a15-42ae-9328-080ca44e1ce6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:12.557047 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bca8e89c-0a15-42ae-9328-080ca44e1ce6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:12.557602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bca8e89c-0a15-42ae-9328-080ca44e1ce6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:12.558442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bca8e89c-0a15-42ae-9328-080ca44e1ce6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:12.558951 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bca8e89c-0a15-42ae-9328-080ca44e1ce6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:12.702811 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bca8e89c-0a15-42ae-9328-080ca44e1ce6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:12.711535 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-ce3e2d20-0ba1-403b-a056-d36c5a7df875 req-43a634a9-94f9-4c5a-8bf3-18b41b409aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f937aa71-eccb-46ec-881c-5ca18c2d6b22", "tag": "1a7bddf0-650f-4019-a4b1-988837b832ec"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:12.712218 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bca8e89c-0a15-42ae-9328-080ca44e1ce6 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1363 microversion: 2.1 time: 0.166797 Jun 22 10:26:12.722061 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 432/856] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:12 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:12.722255 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-ce3e2d20-0ba1-403b-a056-d36c5a7df875 req-43a634a9-94f9-4c5a-8bf3-18b41b409aa4 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:12.722424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-ce3e2d20-0ba1-403b-a056-d36c5a7df875 req-43a634a9-94f9-4c5a-8bf3-18b41b409aa4 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:12.733161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-ce3e2d20-0ba1-403b-a056-d36c5a7df875 req-43a634a9-94f9-4c5a-8bf3-18b41b409aa4 service nova] Creating event network-changed:1a7bddf0-650f-4019-a4b1-988837b832ec for instance f937aa71-eccb-46ec-881c-5ca18c2d6b22 on hv-cinder-84327 Jun 22 10:26:12.741453 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-ce3e2d20-0ba1-403b-a056-d36c5a7df875 req-43a634a9-94f9-4c5a-8bf3-18b41b409aa4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033826 Jun 22 10:26:12.743032 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 425/857] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:26:13.074829 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5a0c5349-8c73-4a7a-b93e-c00a641d9bad tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:13.076007 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5a0c5349-8c73-4a7a-b93e-c00a641d9bad tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:13.082163 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5a0c5349-8c73-4a7a-b93e-c00a641d9bad tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:13.082613 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5a0c5349-8c73-4a7a-b93e-c00a641d9bad tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:13.083412 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5a0c5349-8c73-4a7a-b93e-c00a641d9bad tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:13.083798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5a0c5349-8c73-4a7a-b93e-c00a641d9bad tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:13.259207 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5a0c5349-8c73-4a7a-b93e-c00a641d9bad tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:13.267790 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5a0c5349-8c73-4a7a-b93e-c00a641d9bad tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.197011 Jun 22 10:26:13.268464 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 433/858] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:13 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:13.731153 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0e410c9f-3420-43e0-a747-8d6dcbd5e1bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:13.732669 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0e410c9f-3420-43e0-a747-8d6dcbd5e1bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:13.739828 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0e410c9f-3420-43e0-a747-8d6dcbd5e1bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:13.740292 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0e410c9f-3420-43e0-a747-8d6dcbd5e1bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:13.752519 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0e410c9f-3420-43e0-a747-8d6dcbd5e1bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:13.752519 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0e410c9f-3420-43e0-a747-8d6dcbd5e1bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:13.889030 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0e410c9f-3420-43e0-a747-8d6dcbd5e1bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:13.896760 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0e410c9f-3420-43e0-a747-8d6dcbd5e1bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1363 microversion: 2.1 time: 0.170408 Jun 22 10:26:13.897370 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 426/859] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:13 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:14.286200 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-584926af-0f0f-4fca-bcf7-5229cce92d49 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:14.287074 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-584926af-0f0f-4fca-bcf7-5229cce92d49 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:14.290557 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:14.294246 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-584926af-0f0f-4fca-bcf7-5229cce92d49 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:14.294695 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-584926af-0f0f-4fca-bcf7-5229cce92d49 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:14.295542 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-584926af-0f0f-4fca-bcf7-5229cce92d49 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:14.295985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-584926af-0f0f-4fca-bcf7-5229cce92d49 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:14.439044 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-584926af-0f0f-4fca-bcf7-5229cce92d49 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:14.448193 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-584926af-0f0f-4fca-bcf7-5229cce92d49 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.166064 Jun 22 10:26:14.456901 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 434/860] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:14 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:14.919879 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-aac89c93-9f63-4268-89a2-cc8922d899da tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:14.920503 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-aac89c93-9f63-4268-89a2-cc8922d899da tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:14.936020 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aac89c93-9f63-4268-89a2-cc8922d899da tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:14.936487 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aac89c93-9f63-4268-89a2-cc8922d899da tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:14.937328 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aac89c93-9f63-4268-89a2-cc8922d899da tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:14.938615 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aac89c93-9f63-4268-89a2-cc8922d899da tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:15.131548 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-aac89c93-9f63-4268-89a2-cc8922d899da tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:15.140855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-aac89c93-9f63-4268-89a2-cc8922d899da tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1548 microversion: 2.1 time: 0.230146 Jun 22 10:26:15.141443 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 427/861] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:14 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1548 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:15.157948 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6d08ce3a-dc67-4881-8aa7-d883f9ce606d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:15.158339 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6d08ce3a-dc67-4881-8aa7-d883f9ce606d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:15.165265 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6d08ce3a-dc67-4881-8aa7-d883f9ce606d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:15.165966 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6d08ce3a-dc67-4881-8aa7-d883f9ce606d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:15.166735 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6d08ce3a-dc67-4881-8aa7-d883f9ce606d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:15.167166 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6d08ce3a-dc67-4881-8aa7-d883f9ce606d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:15.245771 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6d08ce3a-dc67-4881-8aa7-d883f9ce606d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092317 Jun 22 10:26:15.246363 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 435/862] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jun 22 10:26:15 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:15.465692 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9d16ec0a-1a8c-4aab-aa3c-e73e025827b3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:15.466756 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9d16ec0a-1a8c-4aab-aa3c-e73e025827b3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:15.473270 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9d16ec0a-1a8c-4aab-aa3c-e73e025827b3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:15.474017 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9d16ec0a-1a8c-4aab-aa3c-e73e025827b3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:15.474959 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9d16ec0a-1a8c-4aab-aa3c-e73e025827b3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:15.475551 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9d16ec0a-1a8c-4aab-aa3c-e73e025827b3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:15.726637 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9d16ec0a-1a8c-4aab-aa3c-e73e025827b3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:15.736198 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9d16ec0a-1a8c-4aab-aa3c-e73e025827b3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.274355 Jun 22 10:26:15.736952 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 428/863] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:15 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:16.651297 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-127eac7b-052c-48b2-a792-0bf4b60549cd req-99b6f542-e08d-40d2-a295-c9a62bda0625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9708aae-3c6d-424c-b082-97d46349a712", "tag": "f6899223-0cb6-4972-ae2f-846f84786e67"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:16.667906 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-127eac7b-052c-48b2-a792-0bf4b60549cd req-99b6f542-e08d-40d2-a295-c9a62bda0625 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:16.668465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-127eac7b-052c-48b2-a792-0bf4b60549cd req-99b6f542-e08d-40d2-a295-c9a62bda0625 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:16.685339 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-127eac7b-052c-48b2-a792-0bf4b60549cd req-99b6f542-e08d-40d2-a295-c9a62bda0625 service nova] Creating event network-changed:f6899223-0cb6-4972-ae2f-846f84786e67 for instance b9708aae-3c6d-424c-b082-97d46349a712 on hv-cinder-84327 Jun 22 10:26:16.690870 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-127eac7b-052c-48b2-a792-0bf4b60549cd req-99b6f542-e08d-40d2-a295-c9a62bda0625 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044559 Jun 22 10:26:16.691989 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 436/864] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:16.756526 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1476666f-1ff2-4ac5-97a9-ea116aae59e0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:16.757359 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1476666f-1ff2-4ac5-97a9-ea116aae59e0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:16.764122 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1476666f-1ff2-4ac5-97a9-ea116aae59e0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:16.764507 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1476666f-1ff2-4ac5-97a9-ea116aae59e0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:16.765515 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1476666f-1ff2-4ac5-97a9-ea116aae59e0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:16.766008 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1476666f-1ff2-4ac5-97a9-ea116aae59e0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:16.915356 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=4 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:16.938528 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=16 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:16.942409 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1476666f-1ff2-4ac5-97a9-ea116aae59e0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:16.952737 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1476666f-1ff2-4ac5-97a9-ea116aae59e0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.202701 Jun 22 10:26:16.953719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 429/865] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:16 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:17.985596 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=4 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:17.986608 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-07723a9d-e67d-4685-9a46-c9072316f93d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:17.987776 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-07723a9d-e67d-4685-9a46-c9072316f93d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:17.998750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-07723a9d-e67d-4685-9a46-c9072316f93d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:17.999450 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-07723a9d-e67d-4685-9a46-c9072316f93d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:18.000620 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-07723a9d-e67d-4685-9a46-c9072316f93d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:18.001411 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-07723a9d-e67d-4685-9a46-c9072316f93d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:18.143494 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-07723a9d-e67d-4685-9a46-c9072316f93d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:18.151030 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-07723a9d-e67d-4685-9a46-c9072316f93d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.184374 Jun 22 10:26:18.151601 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 437/866] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:17 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:19.167591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2d6bbdb7-7051-4989-8648-181658ddd7f8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:19.168207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2d6bbdb7-7051-4989-8648-181658ddd7f8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:19.175546 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d6bbdb7-7051-4989-8648-181658ddd7f8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:19.176122 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d6bbdb7-7051-4989-8648-181658ddd7f8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:19.176961 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d6bbdb7-7051-4989-8648-181658ddd7f8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:19.177403 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d6bbdb7-7051-4989-8648-181658ddd7f8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:19.311704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2d6bbdb7-7051-4989-8648-181658ddd7f8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:19.319707 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2d6bbdb7-7051-4989-8648-181658ddd7f8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.155642 Jun 22 10:26:19.320361 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 430/867] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:19 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:20.337274 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3583f5ed-2491-42ef-992c-3ac426db38a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:20.337885 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3583f5ed-2491-42ef-992c-3ac426db38a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:20.345637 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3583f5ed-2491-42ef-992c-3ac426db38a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:20.346090 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3583f5ed-2491-42ef-992c-3ac426db38a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:20.346868 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3583f5ed-2491-42ef-992c-3ac426db38a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:20.347310 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3583f5ed-2491-42ef-992c-3ac426db38a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:20.478380 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3583f5ed-2491-42ef-992c-3ac426db38a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:20.486810 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3583f5ed-2491-42ef-992c-3ac426db38a8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.153248 Jun 22 10:26:20.487582 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 438/868] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:20 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:21.503710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8231472f-3dfa-4fdb-ad51-5c006781edc7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:21.504284 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8231472f-3dfa-4fdb-ad51-5c006781edc7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:21.510858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8231472f-3dfa-4fdb-ad51-5c006781edc7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:21.511308 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8231472f-3dfa-4fdb-ad51-5c006781edc7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:21.512071 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8231472f-3dfa-4fdb-ad51-5c006781edc7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:21.513116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8231472f-3dfa-4fdb-ad51-5c006781edc7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:21.646954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8231472f-3dfa-4fdb-ad51-5c006781edc7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:21.654450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8231472f-3dfa-4fdb-ad51-5c006781edc7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.154654 Jun 22 10:26:21.655023 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 431/869] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:21 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:22.675617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-94dd8cce-d9f1-468c-b218-6635560f4f76 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:22.679915 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-94dd8cce-d9f1-468c-b218-6635560f4f76 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:22.695944 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-94dd8cce-d9f1-468c-b218-6635560f4f76 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:22.696722 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-94dd8cce-d9f1-468c-b218-6635560f4f76 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:22.697808 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-94dd8cce-d9f1-468c-b218-6635560f4f76 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:22.698406 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-94dd8cce-d9f1-468c-b218-6635560f4f76 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:22.847196 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-94dd8cce-d9f1-468c-b218-6635560f4f76 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:22.854827 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-94dd8cce-d9f1-468c-b218-6635560f4f76 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.187165 Jun 22 10:26:22.855400 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 439/870] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:22 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:23.876023 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4b62c620-6613-4335-8b1a-80c8014996eb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:23.876943 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4b62c620-6613-4335-8b1a-80c8014996eb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:23.884515 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4b62c620-6613-4335-8b1a-80c8014996eb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:23.885176 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4b62c620-6613-4335-8b1a-80c8014996eb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:23.886779 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4b62c620-6613-4335-8b1a-80c8014996eb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:23.887247 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4b62c620-6613-4335-8b1a-80c8014996eb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:24.064538 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4b62c620-6613-4335-8b1a-80c8014996eb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:24.072285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4b62c620-6613-4335-8b1a-80c8014996eb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.200799 Jun 22 10:26:24.073460 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 432/871] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:23 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:25.097238 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5ad152c0-b2bc-45d0-989b-53eb792fc518 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:25.100484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5ad152c0-b2bc-45d0-989b-53eb792fc518 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:25.112582 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5ad152c0-b2bc-45d0-989b-53eb792fc518 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:25.113723 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5ad152c0-b2bc-45d0-989b-53eb792fc518 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:25.115465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5ad152c0-b2bc-45d0-989b-53eb792fc518 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:25.116397 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5ad152c0-b2bc-45d0-989b-53eb792fc518 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:25.289980 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5ad152c0-b2bc-45d0-989b-53eb792fc518 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:25.300430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5ad152c0-b2bc-45d0-989b-53eb792fc518 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.213121 Jun 22 10:26:25.301179 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 440/872] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:25 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:26.091401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d6fca7c4-deac-436c-a9e0-daf6c723580d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: .version_select at 0x7f021fb4a820>, body: {"keypair": {"name": "tempest-keypair-428846125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNh4YN5OTIq4AbadHJ/u2JdDqruk4gKDZUlJTlL+VL0/VHKPnELdOMWjtQddK8wrqqSS0vXtiTZN2pwQNzVMDRmG2NCTr+Tn3LXt71LPVV4PjyS0cXh4LAm4qCbtR9Y9ZA=="}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:26.106415 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-d6fca7c4-deac-436c-a9e0-daf6c723580d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for project 347c4ccbcb464091b8254475babf2874. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:26:26.110409 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-d6fca7c4-deac-436c-a9e0-daf6c723580d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for user 082ece6ea4244242a6ba99152572c80f and project 347c4ccbcb464091b8254475babf2874. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:26:26.214007 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d6fca7c4-deac-436c-a9e0-daf6c723580d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.259288 Jun 22 10:26:26.214615 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 433/873] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jun 22 10:26:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:26.320235 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-44ca9507-5c9a-42f1-9d44-9f809ad88b92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:26.321286 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-44ca9507-5c9a-42f1-9d44-9f809ad88b92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:26.328407 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-44ca9507-5c9a-42f1-9d44-9f809ad88b92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:26.328904 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-44ca9507-5c9a-42f1-9d44-9f809ad88b92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:26.329696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-44ca9507-5c9a-42f1-9d44-9f809ad88b92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:26.330134 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-44ca9507-5c9a-42f1-9d44-9f809ad88b92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:26.486837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-44ca9507-5c9a-42f1-9d44-9f809ad88b92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:26.494965 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-44ca9507-5c9a-42f1-9d44-9f809ad88b92 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.179720 Jun 22 10:26:26.496872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 441/874] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:26 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:26.727910 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-98be3564-1e28-4f02-a880-371fe0df114a req-71baded5-319d-4f92-a9ef-ba4444d3ebb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f937aa71-eccb-46ec-881c-5ca18c2d6b22", "name": "network-vif-plugged", "status": "completed", "tag": "1a7bddf0-650f-4019-a4b1-988837b832ec"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:26.739216 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-98be3564-1e28-4f02-a880-371fe0df114a req-71baded5-319d-4f92-a9ef-ba4444d3ebb7 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:26.739655 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-98be3564-1e28-4f02-a880-371fe0df114a req-71baded5-319d-4f92-a9ef-ba4444d3ebb7 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:26.751382 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-98be3564-1e28-4f02-a880-371fe0df114a req-71baded5-319d-4f92-a9ef-ba4444d3ebb7 service nova] Creating event network-vif-plugged:1a7bddf0-650f-4019-a4b1-988837b832ec for instance f937aa71-eccb-46ec-881c-5ca18c2d6b22 on hv-cinder-84327 Jun 22 10:26:26.756849 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-98be3564-1e28-4f02-a880-371fe0df114a req-71baded5-319d-4f92-a9ef-ba4444d3ebb7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032863 Jun 22 10:26:26.757685 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 434/875] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:27.511407 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-57725638-a922-454d-99ab-a05d184375dd tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:27.512012 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-57725638-a922-454d-99ab-a05d184375dd tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:27.519201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57725638-a922-454d-99ab-a05d184375dd tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:27.519644 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57725638-a922-454d-99ab-a05d184375dd tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:27.520410 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57725638-a922-454d-99ab-a05d184375dd tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:27.520844 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-57725638-a922-454d-99ab-a05d184375dd tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:27.676388 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-57725638-a922-454d-99ab-a05d184375dd tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:27.685338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-57725638-a922-454d-99ab-a05d184375dd tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.177633 Jun 22 10:26:27.685909 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 442/876] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:27 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:28.702563 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0e7024d3-b08a-400f-a432-ddc48fa089a5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:28.708259 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0e7024d3-b08a-400f-a432-ddc48fa089a5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:28.715686 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0e7024d3-b08a-400f-a432-ddc48fa089a5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:28.716151 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0e7024d3-b08a-400f-a432-ddc48fa089a5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:28.716981 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0e7024d3-b08a-400f-a432-ddc48fa089a5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:28.717415 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0e7024d3-b08a-400f-a432-ddc48fa089a5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:28.873381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0e7024d3-b08a-400f-a432-ddc48fa089a5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:28.884455 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0e7024d3-b08a-400f-a432-ddc48fa089a5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1265 microversion: 2.1 time: 0.185589 Jun 22 10:26:28.885841 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 435/877] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:28 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:29.473354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1173051972", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50c0d4d4-6a37-4a0f-93d4-ead4b389795a"}], "security_groups": [{"name": "tempest-securitygroup--822382066"}], "key_name": "tempest-keypair-428846125", "user_data": "}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:29.582768 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.network.neutron [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] validate_networks() for [('50c0d4d4-6a37-4a0f-93d4-ead4b389795a', None, None, None, None, None)] {{(pid=118327) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:26:29.907083 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-835c60bd-1b91-4ed9-92d5-104353cd579c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:29.907809 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-835c60bd-1b91-4ed9-92d5-104353cd579c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:29.922978 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-835c60bd-1b91-4ed9-92d5-104353cd579c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:29.923591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-835c60bd-1b91-4ed9-92d5-104353cd579c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:29.924653 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-835c60bd-1b91-4ed9-92d5-104353cd579c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:29.925190 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-835c60bd-1b91-4ed9-92d5-104353cd579c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:30.404585 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Flavor limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:26:30.405064 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Image limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:26:30.405542 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Flavor pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:26:30.405955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Image pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:26:30.406553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:26:30.409137 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-835c60bd-1b91-4ed9-92d5-104353cd579c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:30.415894 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:30.416450 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:30.416938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-835c60bd-1b91-4ed9-92d5-104353cd579c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1453 microversion: 2.1 time: 0.519247 Jun 22 10:26:30.417446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:30.417561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 436/878] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:29 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1453 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:30.417944 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:30.433114 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c0579ba3-f73d-4b84-9db8-dc331ab37ae5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:30.433720 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c0579ba3-f73d-4b84-9db8-dc331ab37ae5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:30.435316 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for project 347c4ccbcb464091b8254475babf2874. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:26:30.439447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for user 082ece6ea4244242a6ba99152572c80f and project 347c4ccbcb464091b8254475babf2874. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:26:30.439620 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c0579ba3-f73d-4b84-9db8-dc331ab37ae5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:30.440265 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c0579ba3-f73d-4b84-9db8-dc331ab37ae5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:30.441085 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c0579ba3-f73d-4b84-9db8-dc331ab37ae5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:30.441534 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c0579ba3-f73d-4b84-9db8-dc331ab37ae5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:30.450599 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Going to run 1 instances... {{(pid=118327) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:26:30.452968 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:26:30.574124 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c0579ba3-f73d-4b84-9db8-dc331ab37ae5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:30.582182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c0579ba3-f73d-4b84-9db8-dc331ab37ae5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1453 microversion: 2.1 time: 0.152719 Jun 22 10:26:30.582762 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 437/879] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:30 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:30.622527 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d240e7d2-6db0-4919-ae6d-b9f3d37adddd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.154694 Jun 22 10:26:30.623274 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 443/880] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:26:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:26:30.633643 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e8361e5f-1b20-4772-9206-abca319d7ce8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:30.634732 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e8361e5f-1b20-4772-9206-abca319d7ce8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:30.705349 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e8361e5f-1b20-4772-9206-abca319d7ce8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:30.725455 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e8361e5f-1b20-4772-9206-abca319d7ce8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1241 microversion: 2.1 time: 0.084929 Jun 22 10:26:30.725455 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 438/881] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:30 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:31.733365 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-275be8e1-0166-472f-a3df-c3834f5ee437 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:31.734077 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-275be8e1-0166-472f-a3df-c3834f5ee437 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:31.790504 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-275be8e1-0166-472f-a3df-c3834f5ee437 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:31.797941 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-275be8e1-0166-472f-a3df-c3834f5ee437 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1241 microversion: 2.1 time: 0.069679 Jun 22 10:26:31.798513 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 444/882] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:31 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:32.743494 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-b4f777a1-9554-4ad2-9af2-c1ce9e6f8511 req-2fb47667-9765-4ec1-8a6c-e3abc5507a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f937aa71-eccb-46ec-881c-5ca18c2d6b22", "tag": "1a7bddf0-650f-4019-a4b1-988837b832ec"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:32.753241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-b4f777a1-9554-4ad2-9af2-c1ce9e6f8511 req-2fb47667-9765-4ec1-8a6c-e3abc5507a06 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:32.753683 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-b4f777a1-9554-4ad2-9af2-c1ce9e6f8511 req-2fb47667-9765-4ec1-8a6c-e3abc5507a06 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:32.765248 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-b4f777a1-9554-4ad2-9af2-c1ce9e6f8511 req-2fb47667-9765-4ec1-8a6c-e3abc5507a06 service nova] Creating event network-changed:1a7bddf0-650f-4019-a4b1-988837b832ec for instance f937aa71-eccb-46ec-881c-5ca18c2d6b22 on hv-cinder-84327 Jun 22 10:26:32.770142 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-b4f777a1-9554-4ad2-9af2-c1ce9e6f8511 req-2fb47667-9765-4ec1-8a6c-e3abc5507a06 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030376 Jun 22 10:26:32.771293 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 439/883] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:32.815807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4073ad99-c4d9-4bba-b9db-a9ecaac452ac tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:32.816731 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4073ad99-c4d9-4bba-b9db-a9ecaac452ac tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:32.824379 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4073ad99-c4d9-4bba-b9db-a9ecaac452ac tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:32.828327 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4073ad99-c4d9-4bba-b9db-a9ecaac452ac tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:32.830201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4073ad99-c4d9-4bba-b9db-a9ecaac452ac tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:32.831237 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4073ad99-c4d9-4bba-b9db-a9ecaac452ac tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:32.914527 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4073ad99-c4d9-4bba-b9db-a9ecaac452ac tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:32.925295 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4073ad99-c4d9-4bba-b9db-a9ecaac452ac tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1237 microversion: 2.1 time: 0.113762 Jun 22 10:26:32.935454 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 445/884] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:32 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1237 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:33.952247 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2db94022-5507-4b54-aa67-6bfa7348eddf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:33.952968 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2db94022-5507-4b54-aa67-6bfa7348eddf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:33.959366 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2db94022-5507-4b54-aa67-6bfa7348eddf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:33.959813 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2db94022-5507-4b54-aa67-6bfa7348eddf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:33.960591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2db94022-5507-4b54-aa67-6bfa7348eddf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:33.961052 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2db94022-5507-4b54-aa67-6bfa7348eddf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:34.028674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2db94022-5507-4b54-aa67-6bfa7348eddf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:34.037319 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2db94022-5507-4b54-aa67-6bfa7348eddf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1293 microversion: 2.1 time: 0.090339 Jun 22 10:26:34.037962 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 440/885] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:33 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:35.054443 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7e335d84-d167-478d-89f3-b7e8debde760 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:35.055061 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7e335d84-d167-478d-89f3-b7e8debde760 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:35.061720 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7e335d84-d167-478d-89f3-b7e8debde760 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:35.062176 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7e335d84-d167-478d-89f3-b7e8debde760 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:35.062966 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7e335d84-d167-478d-89f3-b7e8debde760 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:35.063409 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7e335d84-d167-478d-89f3-b7e8debde760 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:35.125555 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7e335d84-d167-478d-89f3-b7e8debde760 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:35.133079 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7e335d84-d167-478d-89f3-b7e8debde760 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1299 microversion: 2.1 time: 0.082709 Jun 22 10:26:35.133639 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 446/886] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:35 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:36.151353 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6b8885df-70ee-4935-9dc1-fa3b285b2fc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:36.151894 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6b8885df-70ee-4935-9dc1-fa3b285b2fc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:36.158594 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6b8885df-70ee-4935-9dc1-fa3b285b2fc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:36.159037 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6b8885df-70ee-4935-9dc1-fa3b285b2fc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:36.159799 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6b8885df-70ee-4935-9dc1-fa3b285b2fc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:36.160229 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6b8885df-70ee-4935-9dc1-fa3b285b2fc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:36.193638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-7b311ac9-a1f9-4b9a-ada8-5fa35177cb11 req-a7f811d0-c5cf-40af-9e80-d5583d84faa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e62bb2-0dfd-4516-a97a-68aa18a98fe6", "tag": "0486dca9-9f57-4bbf-b5a9-72b4e774aea0"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:36.209041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-7b311ac9-a1f9-4b9a-ada8-5fa35177cb11 req-a7f811d0-c5cf-40af-9e80-d5583d84faa9 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:36.209041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-7b311ac9-a1f9-4b9a-ada8-5fa35177cb11 req-a7f811d0-c5cf-40af-9e80-d5583d84faa9 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:36.221322 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-7b311ac9-a1f9-4b9a-ada8-5fa35177cb11 req-a7f811d0-c5cf-40af-9e80-d5583d84faa9 service nova] Creating event network-changed:0486dca9-9f57-4bbf-b5a9-72b4e774aea0 for instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 on hv-cinder-84327 Jun 22 10:26:36.227518 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-7b311ac9-a1f9-4b9a-ada8-5fa35177cb11 req-a7f811d0-c5cf-40af-9e80-d5583d84faa9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044394 Jun 22 10:26:36.229030 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 447/887] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:26:36.319488 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6b8885df-70ee-4935-9dc1-fa3b285b2fc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:36.328119 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6b8885df-70ee-4935-9dc1-fa3b285b2fc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1366 microversion: 2.1 time: 0.181647 Jun 22 10:26:36.328708 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 441/888] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:36 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:37.345092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-68449452-911e-418b-9a40-56e7c6a613cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:37.345797 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-68449452-911e-418b-9a40-56e7c6a613cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:37.352575 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-68449452-911e-418b-9a40-56e7c6a613cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:37.353066 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-68449452-911e-418b-9a40-56e7c6a613cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:37.353844 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-68449452-911e-418b-9a40-56e7c6a613cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:37.354285 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-68449452-911e-418b-9a40-56e7c6a613cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:37.484303 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-68449452-911e-418b-9a40-56e7c6a613cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:37.487883 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:37.494016 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-68449452-911e-418b-9a40-56e7c6a613cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1366 microversion: 2.1 time: 0.151393 Jun 22 10:26:37.494016 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 448/889] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:37 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:38.509667 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f91bf06c-3612-413a-ba09-f4b06545f99b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:38.510291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f91bf06c-3612-413a-ba09-f4b06545f99b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:38.513200 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:38.517941 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f91bf06c-3612-413a-ba09-f4b06545f99b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:38.518384 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f91bf06c-3612-413a-ba09-f4b06545f99b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:38.519133 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f91bf06c-3612-413a-ba09-f4b06545f99b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:38.519559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f91bf06c-3612-413a-ba09-f4b06545f99b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:38.645958 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f91bf06c-3612-413a-ba09-f4b06545f99b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:38.649287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:38.654407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f91bf06c-3612-413a-ba09-f4b06545f99b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1366 microversion: 2.1 time: 0.148626 Jun 22 10:26:38.654988 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 442/890] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:38 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:39.672110 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-91179e9c-6916-4c7d-b129-4aaefd5ed5b4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:39.672725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-91179e9c-6916-4c7d-b129-4aaefd5ed5b4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:39.679946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-91179e9c-6916-4c7d-b129-4aaefd5ed5b4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:39.680394 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-91179e9c-6916-4c7d-b129-4aaefd5ed5b4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:39.681184 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-91179e9c-6916-4c7d-b129-4aaefd5ed5b4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:39.681619 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-91179e9c-6916-4c7d-b129-4aaefd5ed5b4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:39.811542 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-91179e9c-6916-4c7d-b129-4aaefd5ed5b4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:39.818896 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-91179e9c-6916-4c7d-b129-4aaefd5ed5b4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1366 microversion: 2.1 time: 0.151416 Jun 22 10:26:39.819463 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 449/891] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:39 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:40.835861 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4cb3951d-b204-4c94-afd4-62ab4479564a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:40.836579 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4cb3951d-b204-4c94-afd4-62ab4479564a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:40.839072 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=6 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:40.844130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4cb3951d-b204-4c94-afd4-62ab4479564a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:40.844615 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4cb3951d-b204-4c94-afd4-62ab4479564a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:40.859017 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4cb3951d-b204-4c94-afd4-62ab4479564a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:40.859017 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4cb3951d-b204-4c94-afd4-62ab4479564a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:40.975937 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4cb3951d-b204-4c94-afd4-62ab4479564a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:40.983606 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4cb3951d-b204-4c94-afd4-62ab4479564a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1366 microversion: 2.1 time: 0.151930 Jun 22 10:26:40.984171 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 443/892] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:40 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:41.996587 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:41.997871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=8 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:42.001669 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-88a61e53-a9cd-4896-816c-eb21c972a95d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:42.002281 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-88a61e53-a9cd-4896-816c-eb21c972a95d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:42.008317 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-88a61e53-a9cd-4896-816c-eb21c972a95d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:42.008762 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-88a61e53-a9cd-4896-816c-eb21c972a95d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:42.009548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-88a61e53-a9cd-4896-816c-eb21c972a95d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:42.009988 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-88a61e53-a9cd-4896-816c-eb21c972a95d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:42.141869 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-88a61e53-a9cd-4896-816c-eb21c972a95d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:42.149326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-88a61e53-a9cd-4896-816c-eb21c972a95d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1366 microversion: 2.1 time: 0.153427 Jun 22 10:26:42.150022 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 450/893] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:41 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:42.738918 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-d2c34d32-bdac-45bd-914d-2532a9433686 req-be363d82-31d7-4864-8e59-5d55489cb5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e62bb2-0dfd-4516-a97a-68aa18a98fe6", "name": "network-vif-plugged", "status": "completed", "tag": "0486dca9-9f57-4bbf-b5a9-72b4e774aea0"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:42.762693 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-d2c34d32-bdac-45bd-914d-2532a9433686 req-be363d82-31d7-4864-8e59-5d55489cb5ab service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:42.762693 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-d2c34d32-bdac-45bd-914d-2532a9433686 req-be363d82-31d7-4864-8e59-5d55489cb5ab service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:42.762693 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-d2c34d32-bdac-45bd-914d-2532a9433686 req-be363d82-31d7-4864-8e59-5d55489cb5ab service nova] Creating event network-vif-plugged:0486dca9-9f57-4bbf-b5a9-72b4e774aea0 for instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 on hv-cinder-84327 Jun 22 10:26:42.765323 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-d2c34d32-bdac-45bd-914d-2532a9433686 req-be363d82-31d7-4864-8e59-5d55489cb5ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030254 Jun 22 10:26:42.765911 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 444/894] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:43.166965 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4da58ddb-e4cf-44c4-aa39-1397f844df63 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:43.167581 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4da58ddb-e4cf-44c4-aa39-1397f844df63 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:43.174714 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4da58ddb-e4cf-44c4-aa39-1397f844df63 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:43.175162 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4da58ddb-e4cf-44c4-aa39-1397f844df63 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:43.175938 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4da58ddb-e4cf-44c4-aa39-1397f844df63 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:43.176378 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4da58ddb-e4cf-44c4-aa39-1397f844df63 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:43.306389 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4da58ddb-e4cf-44c4-aa39-1397f844df63 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:43.313333 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4da58ddb-e4cf-44c4-aa39-1397f844df63 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1366 microversion: 2.1 time: 0.150238 Jun 22 10:26:43.313889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 451/895] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:43 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:44.330908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-93004fcf-2aef-4347-88fd-37187e4f2972 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:44.331599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-93004fcf-2aef-4347-88fd-37187e4f2972 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:44.337927 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-93004fcf-2aef-4347-88fd-37187e4f2972 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:44.338371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-93004fcf-2aef-4347-88fd-37187e4f2972 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:44.339124 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-93004fcf-2aef-4347-88fd-37187e4f2972 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:44.339550 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-93004fcf-2aef-4347-88fd-37187e4f2972 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:44.472506 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-93004fcf-2aef-4347-88fd-37187e4f2972 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:44.479865 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-93004fcf-2aef-4347-88fd-37187e4f2972 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1366 microversion: 2.1 time: 0.153616 Jun 22 10:26:44.480432 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 445/896] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:44 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:45.497175 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d8ea37b1-93ef-400b-ae39-1d457e9ae906 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:45.497819 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d8ea37b1-93ef-400b-ae39-1d457e9ae906 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:45.504323 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8ea37b1-93ef-400b-ae39-1d457e9ae906 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:45.504773 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8ea37b1-93ef-400b-ae39-1d457e9ae906 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:45.505577 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8ea37b1-93ef-400b-ae39-1d457e9ae906 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:45.506015 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8ea37b1-93ef-400b-ae39-1d457e9ae906 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:45.633483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d8ea37b1-93ef-400b-ae39-1d457e9ae906 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:45.640959 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d8ea37b1-93ef-400b-ae39-1d457e9ae906 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1555 microversion: 2.1 time: 0.148172 Jun 22 10:26:45.641541 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 452/897] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:45 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:45.657971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-93314e18-4799-4a51-808e-c232ab0389ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:45.658569 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-93314e18-4799-4a51-808e-c232ab0389ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:45.665893 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-93314e18-4799-4a51-808e-c232ab0389ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:45.667704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-93314e18-4799-4a51-808e-c232ab0389ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:45.669135 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-93314e18-4799-4a51-808e-c232ab0389ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:45.669575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-93314e18-4799-4a51-808e-c232ab0389ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:45.746861 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-93314e18-4799-4a51-808e-c232ab0389ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092769 Jun 22 10:26:45.747506 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 446/898] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jun 22 10:26:45 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:46.732344 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-25b6764d-3926-48a0-945d-1661af36b812 req-67a918a4-cee9-41dd-bc2f-47dcbbb59875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e62bb2-0dfd-4516-a97a-68aa18a98fe6", "tag": "0486dca9-9f57-4bbf-b5a9-72b4e774aea0"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:46.741041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-25b6764d-3926-48a0-945d-1661af36b812 req-67a918a4-cee9-41dd-bc2f-47dcbbb59875 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:46.741566 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-25b6764d-3926-48a0-945d-1661af36b812 req-67a918a4-cee9-41dd-bc2f-47dcbbb59875 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:46.753442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-25b6764d-3926-48a0-945d-1661af36b812 req-67a918a4-cee9-41dd-bc2f-47dcbbb59875 service nova] Creating event network-changed:0486dca9-9f57-4bbf-b5a9-72b4e774aea0 for instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 on hv-cinder-84327 Jun 22 10:26:46.758653 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-25b6764d-3926-48a0-945d-1661af36b812 req-67a918a4-cee9-41dd-bc2f-47dcbbb59875 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030469 Jun 22 10:26:46.759483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 453/899] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:46.774069 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f33b58be-f4ad-4161-bfb2-5d7e32165103 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1495144866"}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:46.775275 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f33b58be-f4ad-4161-bfb2-5d7e32165103 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:46.781925 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f33b58be-f4ad-4161-bfb2-5d7e32165103 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:46.782515 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f33b58be-f4ad-4161-bfb2-5d7e32165103 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:46.783538 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f33b58be-f4ad-4161-bfb2-5d7e32165103 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:46.784050 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f33b58be-f4ad-4161-bfb2-5d7e32165103 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:46.931989 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.network.security_group_api [None req-f33b58be-f4ad-4161-bfb2-5d7e32165103 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Removing security group 103c4e89-8f20-431c-b1f1-ad4849ba88e0 from port 249b9885-08e1-4d0f-8a26-3a03a7f683a3 Jun 22 10:26:47.386571 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f33b58be-f4ad-4161-bfb2-5d7e32165103 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "POST /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/action" status: 202 len: 0 microversion: 2.1 time: 0.617080 Jun 22 10:26:47.387767 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 447/900] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:26:46 2022] POST /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:26:47.397909 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-4e16e4ca-7bdc-4eb8-944e-d0eca3028d82 req-06aae7fa-375a-4678-8624-1c07c8a258bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4e73d9-0607-4ae9-8fb5-30bd61f928f1", "tag": "249b9885-08e1-4d0f-8a26-3a03a7f683a3"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:47.417093 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-4e16e4ca-7bdc-4eb8-944e-d0eca3028d82 req-06aae7fa-375a-4678-8624-1c07c8a258bc service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:47.419906 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-4e16e4ca-7bdc-4eb8-944e-d0eca3028d82 req-06aae7fa-375a-4678-8624-1c07c8a258bc service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:47.441605 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-4e16e4ca-7bdc-4eb8-944e-d0eca3028d82 req-06aae7fa-375a-4678-8624-1c07c8a258bc service nova] Creating event network-changed:249b9885-08e1-4d0f-8a26-3a03a7f683a3 for instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 on hv-cinder-84327 Jun 22 10:26:47.447933 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-4e16e4ca-7bdc-4eb8-944e-d0eca3028d82 req-06aae7fa-375a-4678-8624-1c07c8a258bc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054456 Jun 22 10:26:47.450449 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 454/901] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:48.746946 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b0d98d6b-ef27-4315-9ee1-3130c1510949 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:48.747488 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b0d98d6b-ef27-4315-9ee1-3130c1510949 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:48.753765 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b0d98d6b-ef27-4315-9ee1-3130c1510949 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:48.754206 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b0d98d6b-ef27-4315-9ee1-3130c1510949 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:48.754965 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b0d98d6b-ef27-4315-9ee1-3130c1510949 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:48.755391 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b0d98d6b-ef27-4315-9ee1-3130c1510949 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:48.878448 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-b0d98d6b-ef27-4315-9ee1-3130c1510949 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lazy-loading 'services' on Instance uuid 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:26:49.155529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b0d98d6b-ef27-4315-9ee1-3130c1510949 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments/661d98d1-92c9-4102-bcd7-b401e04f18f5" status: 202 len: 0 microversion: 2.1 time: 0.412771 Jun 22 10:26:49.156276 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 448/902] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jun 22 10:26:48 2022] DELETE /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments/661d98d1-92c9-4102-bcd7-b401e04f18f5 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:26:49.166356 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-44d97da8-73a8-4fb7-8126-0ca7123a1f33 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:49.167397 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-44d97da8-73a8-4fb7-8126-0ca7123a1f33 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:49.169907 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:49.174914 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-44d97da8-73a8-4fb7-8126-0ca7123a1f33 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:49.175362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-44d97da8-73a8-4fb7-8126-0ca7123a1f33 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:49.176153 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-44d97da8-73a8-4fb7-8126-0ca7123a1f33 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:49.176585 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-44d97da8-73a8-4fb7-8126-0ca7123a1f33 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:49.207889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-44d97da8-73a8-4fb7-8126-0ca7123a1f33 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046296 Jun 22 10:26:49.208464 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 455/903] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:26:49 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:49.464653 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-a7c3d8bf-f401-4c1f-955f-fc231a5d9b48 req-0b1c3557-5b8e-4acb-b4b3-f5717ec71f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e4e73d9-0607-4ae9-8fb5-30bd61f928f1", "tag": "249b9885-08e1-4d0f-8a26-3a03a7f683a3"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:49.473097 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-a7c3d8bf-f401-4c1f-955f-fc231a5d9b48 req-0b1c3557-5b8e-4acb-b4b3-f5717ec71f37 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:49.473532 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-a7c3d8bf-f401-4c1f-955f-fc231a5d9b48 req-0b1c3557-5b8e-4acb-b4b3-f5717ec71f37 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:49.483939 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-a7c3d8bf-f401-4c1f-955f-fc231a5d9b48 req-0b1c3557-5b8e-4acb-b4b3-f5717ec71f37 service nova] Creating event network-changed:249b9885-08e1-4d0f-8a26-3a03a7f683a3 for instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 on hv-cinder-84327 Jun 22 10:26:49.488789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-a7c3d8bf-f401-4c1f-955f-fc231a5d9b48 req-0b1c3557-5b8e-4acb-b4b3-f5717ec71f37 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028260 Jun 22 10:26:49.489417 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 449/904] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:50.221081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4011d57e-5b5f-4dae-b39b-2ffe6e332772 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:50.221919 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4011d57e-5b5f-4dae-b39b-2ffe6e332772 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:50.229261 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4011d57e-5b5f-4dae-b39b-2ffe6e332772 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:50.229717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4011d57e-5b5f-4dae-b39b-2ffe6e332772 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:50.230535 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4011d57e-5b5f-4dae-b39b-2ffe6e332772 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:50.231509 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4011d57e-5b5f-4dae-b39b-2ffe6e332772 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:50.260500 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4011d57e-5b5f-4dae-b39b-2ffe6e332772 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044045 Jun 22 10:26:50.261096 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 456/905] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:26:50 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:51.277923 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-aa6d2304-c9c8-4a12-8e92-c30df9556a8f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:51.278984 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-aa6d2304-c9c8-4a12-8e92-c30df9556a8f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:51.287337 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aa6d2304-c9c8-4a12-8e92-c30df9556a8f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:51.287790 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aa6d2304-c9c8-4a12-8e92-c30df9556a8f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:51.288567 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aa6d2304-c9c8-4a12-8e92-c30df9556a8f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:51.289041 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aa6d2304-c9c8-4a12-8e92-c30df9556a8f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:51.319652 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-aa6d2304-c9c8-4a12-8e92-c30df9556a8f tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047261 Jun 22 10:26:51.320441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 450/906] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:26:51 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:26:51.332208 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-19b70b48-222d-4714-9f5c-e6cc5fad3fd6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:51.332758 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-19b70b48-222d-4714-9f5c-e6cc5fad3fd6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:51.340871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-19b70b48-222d-4714-9f5c-e6cc5fad3fd6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:51.341326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-19b70b48-222d-4714-9f5c-e6cc5fad3fd6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:51.342091 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-19b70b48-222d-4714-9f5c-e6cc5fad3fd6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:51.342539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-19b70b48-222d-4714-9f5c-e6cc5fad3fd6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:51.425127 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-19b70b48-222d-4714-9f5c-e6cc5fad3fd6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] HTTP exception thrown: Instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 is not attached to volume 661d98d1-92c9-4102-bcd7-b401e04f18f5 Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-19b70b48-222d-4714-9f5c-e6cc5fad3fd6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Request method failure captured: Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: DELETE /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments/661d98d1-92c9-4102-bcd7-b401e04f18f5 HTTP/1.1 Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu1ztaAI3R21hNkA4Pvtp8qKLMhOzozsexU9YCNcSMRo1K4UkbdwLEhAJZd8TZs1-4P-7q176Cqxr48kPZh3BvV_xGeDHH4gTo2KrmG9i3U4dDBB0UZ677QSqSJOZPzww2k94AYhtECg8rnEB42DvPj1uKRngp7pC1ncqygf-57Ut4I Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 9dfa249b41a8422fae46988649977e6e Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-TestMinimumBasicScenario-1038787787 Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:26:51.427414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:26:51.429095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9dfa249b41a8422fae46988649977e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9dfa249b41a8422fae46988649977e6e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9dfa249b41a8422fae46988649977e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9dfa249b41a8422fae46988649977e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:26:51.429095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-TestMinimumBasicScenario-1038787787 Jun 22 10:26:51.429095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 9dfa249b41a8422fae46988649977e6e Jun 22 10:26:51.429095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1038787787 Jun 22 10:26:51.429095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-TestMinimumBasicScenario-1038787787-project Jun 22 10:26:51.429095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:26:51.429095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:26:51.429095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: f778bbdc67024183aca4711b9d87105e Jun 22 10:26:51.429095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-TestMinimumBasicScenario-1038787787-project Jun 22 10:26:51.429095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:26:51.429095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 is not attached to volume 661d98d1-92c9-4102-bcd7-b401e04f18f5 Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'server_id': '2e4e73d9-0607-4ae9-8fb5-30bd61f928f1', 'id': '661d98d1-92c9-4102-bcd7-b401e04f18f5'} Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 661d98d1-92c9-4102-bcd7-b401e04f18f5. Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:26:51.430002 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 is not attached to volume 661d98d1-92c9-4102-bcd7-b401e04f18f5 Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 is not attached to volume 661d98d1-92c9-4102-bcd7-b401e04f18f5 Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:26:51.431552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-19b70b48-222d-4714-9f5c-e6cc5fad3fd6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Returning 404 to user: Instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 is not attached to volume 661d98d1-92c9-4102-bcd7-b401e04f18f5 {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:26:51.432986 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-19b70b48-222d-4714-9f5c-e6cc5fad3fd6 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments/661d98d1-92c9-4102-bcd7-b401e04f18f5" status: 404 len: 154 microversion: 2.1 time: 0.101255 Jun 22 10:26:51.432986 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 457/907] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jun 22 10:26:51 2022] DELETE /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1/os-volume_attachments/661d98d1-92c9-4102-bcd7-b401e04f18f5 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:26:52.726020 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-48bb274f-85f5-4302-8225-96896710fca2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:52.726492 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-48bb274f-85f5-4302-8225-96896710fca2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:52.732786 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-48bb274f-85f5-4302-8225-96896710fca2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:52.733272 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-48bb274f-85f5-4302-8225-96896710fca2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:52.734018 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-48bb274f-85f5-4302-8225-96896710fca2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:52.734451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-48bb274f-85f5-4302-8225-96896710fca2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:52.758067 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-48bb274f-85f5-4302-8225-96896710fca2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:26:53.186901 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-48bb274f-85f5-4302-8225-96896710fca2 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 204 len: 0 microversion: 2.1 time: 0.464314 Jun 22 10:26:53.187484 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 451/908] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:26:52 2022] DELETE /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:26:53.195916 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fff8d4c1-b425-4535-a21b-5a10eaf0359c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:53.196541 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-fff8d4c1-b425-4535-a21b-5a10eaf0359c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:53.203790 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fff8d4c1-b425-4535-a21b-5a10eaf0359c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:53.204244 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fff8d4c1-b425-4535-a21b-5a10eaf0359c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:53.205046 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fff8d4c1-b425-4535-a21b-5a10eaf0359c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:53.205492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fff8d4c1-b425-4535-a21b-5a10eaf0359c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:53.335309 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-fff8d4c1-b425-4535-a21b-5a10eaf0359c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:53.343152 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-fff8d4c1-b425-4535-a21b-5a10eaf0359c tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1554 microversion: 2.1 time: 0.151176 Jun 22 10:26:53.343707 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 458/909] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:53 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:54.361613 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-da9a3c9c-4013-4915-aef1-678d0db22625 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:54.362319 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-da9a3c9c-4013-4915-aef1-678d0db22625 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:54.370974 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-da9a3c9c-4013-4915-aef1-678d0db22625 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:54.371427 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-da9a3c9c-4013-4915-aef1-678d0db22625 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:54.372832 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-da9a3c9c-4013-4915-aef1-678d0db22625 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:54.373293 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-da9a3c9c-4013-4915-aef1-678d0db22625 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:54.534353 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-da9a3c9c-4013-4915-aef1-678d0db22625 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:54.542074 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-da9a3c9c-4013-4915-aef1-678d0db22625 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1554 microversion: 2.1 time: 0.185253 Jun 22 10:26:54.542631 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 452/910] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:54 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:55.559491 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d7067780-c75e-497f-a214-bf8a11ed8999 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:55.560666 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d7067780-c75e-497f-a214-bf8a11ed8999 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:55.567337 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d7067780-c75e-497f-a214-bf8a11ed8999 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:55.567786 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d7067780-c75e-497f-a214-bf8a11ed8999 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:55.568979 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d7067780-c75e-497f-a214-bf8a11ed8999 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:55.569082 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d7067780-c75e-497f-a214-bf8a11ed8999 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:55.701202 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d7067780-c75e-497f-a214-bf8a11ed8999 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:55.708746 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d7067780-c75e-497f-a214-bf8a11ed8999 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1554 microversion: 2.1 time: 0.153099 Jun 22 10:26:55.709345 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 459/911] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:55 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:56.074133 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-dab546b9-5ae4-4ff3-aaf0-d202c1c6861f req-e75a8cae-2c42-4562-9538-4b975e12e2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e4e73d9-0607-4ae9-8fb5-30bd61f928f1", "name": "network-vif-deleted", "tag": "249b9885-08e1-4d0f-8a26-3a03a7f683a3"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:56.083268 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-dab546b9-5ae4-4ff3-aaf0-d202c1c6861f req-e75a8cae-2c42-4562-9538-4b975e12e2d9 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:56.087659 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-dab546b9-5ae4-4ff3-aaf0-d202c1c6861f req-e75a8cae-2c42-4562-9538-4b975e12e2d9 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:56.094519 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-dab546b9-5ae4-4ff3-aaf0-d202c1c6861f req-e75a8cae-2c42-4562-9538-4b975e12e2d9 service nova] Creating event network-vif-deleted:249b9885-08e1-4d0f-8a26-3a03a7f683a3 for instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 on hv-cinder-84327 Jun 22 10:26:56.099391 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-dab546b9-5ae4-4ff3-aaf0-d202c1c6861f req-e75a8cae-2c42-4562-9538-4b975e12e2d9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028895 Jun 22 10:26:56.100005 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 453/912] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:56.725778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7999eb99-34d0-4675-8dd2-f351047c796b tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:56.726413 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7999eb99-34d0-4675-8dd2-f351047c796b tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:56.733490 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7999eb99-34d0-4675-8dd2-f351047c796b tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:56.733944 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7999eb99-34d0-4675-8dd2-f351047c796b tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:56.734710 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7999eb99-34d0-4675-8dd2-f351047c796b tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:56.735150 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7999eb99-34d0-4675-8dd2-f351047c796b tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:56.765637 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7999eb99-34d0-4675-8dd2-f351047c796b tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:56.766082 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7999eb99-34d0-4675-8dd2-f351047c796b tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:56.766538 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-7999eb99-34d0-4675-8dd2-f351047c796b tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lazy-loading 'fault' on Instance uuid 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:26:56.807101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7999eb99-34d0-4675-8dd2-f351047c796b tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f778bbdc67024183aca4711b9d87105e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dfa249b41a8422fae46988649977e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:56.814836 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7999eb99-34d0-4675-8dd2-f351047c796b tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 200 len: 1348 microversion: 2.1 time: 0.092939 Jun 22 10:26:56.815391 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 460/913] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:56 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 1348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:57.832293 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a5954d18-5671-4737-b775-c599fe1650b1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:57.833016 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a5954d18-5671-4737-b775-c599fe1650b1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] [instance: 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:57.839656 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a5954d18-5671-4737-b775-c599fe1650b1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.840106 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a5954d18-5671-4737-b775-c599fe1650b1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.841419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a5954d18-5671-4737-b775-c599fe1650b1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.841857 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a5954d18-5671-4737-b775-c599fe1650b1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.854990 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-a5954d18-5671-4737-b775-c599fe1650b1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] HTTP exception thrown: Instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 could not be found. Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a5954d18-5671-4737-b775-c599fe1650b1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Request method failure captured: Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 HTTP/1.1 Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu1ztaAI3R21hNkA4Pvtp8qKLMhOzozsexU9YCNcSMRo1K4UkbdwLEhAJZd8TZs1-4P-7q176Cqxr48kPZh3BvV_xGeDHH4gTo2KrmG9i3U4dDBB0UZ677QSqSJOZPzww2k94AYhtECg8rnEB42DvPj1uKRngp7pC1ncqygf-57Ut4I Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 9dfa249b41a8422fae46988649977e6e Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-TestMinimumBasicScenario-1038787787 Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:26:57.857285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:26:57.858814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9dfa249b41a8422fae46988649977e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9dfa249b41a8422fae46988649977e6e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9dfa249b41a8422fae46988649977e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9dfa249b41a8422fae46988649977e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:26:57.858814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-TestMinimumBasicScenario-1038787787 Jun 22 10:26:57.858814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 9dfa249b41a8422fae46988649977e6e Jun 22 10:26:57.858814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1038787787 Jun 22 10:26:57.858814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-TestMinimumBasicScenario-1038787787-project Jun 22 10:26:57.858814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:26:57.858814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:26:57.858814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: f778bbdc67024183aca4711b9d87105e Jun 22 10:26:57.858814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-TestMinimumBasicScenario-1038787787-project Jun 22 10:26:57.858814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:26:57.858814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 could not be found. Jun 22 10:26:57.858814 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '2e4e73d9-0607-4ae9-8fb5-30bd61f928f1'} Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 could not be found. Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:26:57.859704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 could not be found. Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 could not be found. Jun 22 10:26:57.861182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:26:57.862553 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a5954d18-5671-4737-b775-c599fe1650b1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Returning 404 to user: Instance 2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:26:57.862553 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a5954d18-5671-4737-b775-c599fe1650b1 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1" status: 404 len: 111 microversion: 2.1 time: 0.030565 Jun 22 10:26:57.862553 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 454/914] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:57 2022] GET /compute/v2.1/servers/2e4e73d9-0607-4ae9-8fb5-30bd61f928f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:26:57.867410 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ab556e7b-6b78-4c58-99f8-df16604944b8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] Calling method '.version_select at 0x7f021fcc1af0>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:57.939239 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ab556e7b-6b78-4c58-99f8-df16604944b8 tempest-TestMinimumBasicScenario-1038787787 tempest-TestMinimumBasicScenario-1038787787-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-456424453" status: 202 len: 0 microversion: 2.1 time: 0.075610 Jun 22 10:26:57.939843 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 461/915] 10.222.0.46 () {58 vars in 1268 bytes} [Wed Jun 22 10:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-456424453 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:27:00.990562 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a0d18f0e-6cab-4713-90eb-a2520240ac04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:00.991132 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a0d18f0e-6cab-4713-90eb-a2520240ac04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:00.997502 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a0d18f0e-6cab-4713-90eb-a2520240ac04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:00.997967 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a0d18f0e-6cab-4713-90eb-a2520240ac04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:00.998909 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a0d18f0e-6cab-4713-90eb-a2520240ac04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:00.999352 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a0d18f0e-6cab-4713-90eb-a2520240ac04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:01.022578 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a0d18f0e-6cab-4713-90eb-a2520240ac04 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/ips" status: 200 len: 151 microversion: 2.20 time: 0.035810 Jun 22 10:27:01.023059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 455/916] 10.222.0.46 () {60 vars in 1288 bytes} [Wed Jun 22 10:27:00 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:27:04.281469 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-476af24f-0269-4309-8f39-7b46a066c99e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:04.282110 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-476af24f-0269-4309-8f39-7b46a066c99e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:04.289222 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-476af24f-0269-4309-8f39-7b46a066c99e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:04.289675 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-476af24f-0269-4309-8f39-7b46a066c99e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:04.290424 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-476af24f-0269-4309-8f39-7b46a066c99e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:04.290855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-476af24f-0269-4309-8f39-7b46a066c99e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:04.314040 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-476af24f-0269-4309-8f39-7b46a066c99e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lazy-loading 'flavor' on Instance uuid 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:27:05.054215 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-476af24f-0269-4309-8f39-7b46a066c99e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "POST /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/action" status: 202 len: 0 microversion: 2.20 time: 0.777196 Jun 22 10:27:05.055001 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 462/917] 10.222.0.46 () {62 vars in 1318 bytes} [Wed Jun 22 10:27:04 2022] POST /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/action => generated 0 bytes in 779 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:27:05.063439 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-fb8758c1-0100-4db8-8c42-1e0b8b1f9b8e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:05.064398 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-fb8758c1-0100-4db8-8c42-1e0b8b1f9b8e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:05.072018 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fb8758c1-0100-4db8-8c42-1e0b8b1f9b8e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:05.072534 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fb8758c1-0100-4db8-8c42-1e0b8b1f9b8e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:05.073420 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fb8758c1-0100-4db8-8c42-1e0b8b1f9b8e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:05.073939 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fb8758c1-0100-4db8-8c42-1e0b8b1f9b8e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:05.268479 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-fb8758c1-0100-4db8-8c42-1e0b8b1f9b8e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:05.278466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-fb8758c1-0100-4db8-8c42-1e0b8b1f9b8e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:05.280635 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-fb8758c1-0100-4db8-8c42-1e0b8b1f9b8e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:05.310774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-fb8758c1-0100-4db8-8c42-1e0b8b1f9b8e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.222513 Jun 22 10:27:05.310774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 456/918] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:05 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:27:06.328940 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c30cddcc-eab6-4c69-964d-fd8fe6341de6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:06.336938 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c30cddcc-eab6-4c69-964d-fd8fe6341de6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:06.344386 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c30cddcc-eab6-4c69-964d-fd8fe6341de6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:06.345120 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c30cddcc-eab6-4c69-964d-fd8fe6341de6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:06.345906 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c30cddcc-eab6-4c69-964d-fd8fe6341de6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:06.346339 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c30cddcc-eab6-4c69-964d-fd8fe6341de6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:06.494267 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c30cddcc-eab6-4c69-964d-fd8fe6341de6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:06.503300 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c30cddcc-eab6-4c69-964d-fd8fe6341de6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:06.504810 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c30cddcc-eab6-4c69-964d-fd8fe6341de6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:06.505984 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c30cddcc-eab6-4c69-964d-fd8fe6341de6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.181915 Jun 22 10:27:06.506532 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 463/919] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:06 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:07.523825 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a330ee47-953e-4b2f-80da-77814858fd6e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:07.524357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a330ee47-953e-4b2f-80da-77814858fd6e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:07.531221 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a330ee47-953e-4b2f-80da-77814858fd6e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:07.531668 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a330ee47-953e-4b2f-80da-77814858fd6e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:07.532433 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a330ee47-953e-4b2f-80da-77814858fd6e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:07.532932 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a330ee47-953e-4b2f-80da-77814858fd6e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:07.754121 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a330ee47-953e-4b2f-80da-77814858fd6e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:07.762726 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a330ee47-953e-4b2f-80da-77814858fd6e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:07.764367 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a330ee47-953e-4b2f-80da-77814858fd6e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:07.765678 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a330ee47-953e-4b2f-80da-77814858fd6e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.246031 Jun 22 10:27:07.766344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 457/920] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:07 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:08.784557 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3b1487dd-3bd3-46be-bccd-6ab5e4172c1f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:08.785199 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3b1487dd-3bd3-46be-bccd-6ab5e4172c1f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:08.792069 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3b1487dd-3bd3-46be-bccd-6ab5e4172c1f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:08.792523 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3b1487dd-3bd3-46be-bccd-6ab5e4172c1f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:08.793321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3b1487dd-3bd3-46be-bccd-6ab5e4172c1f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:08.793760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3b1487dd-3bd3-46be-bccd-6ab5e4172c1f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:08.927418 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3b1487dd-3bd3-46be-bccd-6ab5e4172c1f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:08.935604 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3b1487dd-3bd3-46be-bccd-6ab5e4172c1f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:08.937173 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3b1487dd-3bd3-46be-bccd-6ab5e4172c1f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:08.938367 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3b1487dd-3bd3-46be-bccd-6ab5e4172c1f tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.157796 Jun 22 10:27:08.938925 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 464/921] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:08 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:09.962580 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-961dcfbf-f086-408a-8630-d7316b4336d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:09.963186 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-961dcfbf-f086-408a-8630-d7316b4336d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:09.965654 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:09.970399 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-961dcfbf-f086-408a-8630-d7316b4336d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:09.970850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-961dcfbf-f086-408a-8630-d7316b4336d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:09.971611 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-961dcfbf-f086-408a-8630-d7316b4336d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:09.972051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-961dcfbf-f086-408a-8630-d7316b4336d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:10.100056 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-961dcfbf-f086-408a-8630-d7316b4336d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:10.109120 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-961dcfbf-f086-408a-8630-d7316b4336d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:10.110690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-961dcfbf-f086-408a-8630-d7316b4336d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:10.111890 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-961dcfbf-f086-408a-8630-d7316b4336d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.153416 Jun 22 10:27:10.112466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 458/922] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:09 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:11.130495 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b21013b4-8697-498b-a3ac-d9281d47292d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:11.131131 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b21013b4-8697-498b-a3ac-d9281d47292d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:11.137555 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b21013b4-8697-498b-a3ac-d9281d47292d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:11.138013 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b21013b4-8697-498b-a3ac-d9281d47292d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:11.139409 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b21013b4-8697-498b-a3ac-d9281d47292d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:11.139844 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b21013b4-8697-498b-a3ac-d9281d47292d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:11.142552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:11.269840 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b21013b4-8697-498b-a3ac-d9281d47292d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:11.277642 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b21013b4-8697-498b-a3ac-d9281d47292d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:11.279161 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b21013b4-8697-498b-a3ac-d9281d47292d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:11.280317 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b21013b4-8697-498b-a3ac-d9281d47292d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.153735 Jun 22 10:27:11.280900 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 465/923] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:11 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:12.298754 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-cf802847-201a-45d7-b31c-48308f22e526 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:12.299395 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-cf802847-201a-45d7-b31c-48308f22e526 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:12.306186 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cf802847-201a-45d7-b31c-48308f22e526 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:12.306638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cf802847-201a-45d7-b31c-48308f22e526 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:12.307410 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cf802847-201a-45d7-b31c-48308f22e526 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:12.307855 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cf802847-201a-45d7-b31c-48308f22e526 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:12.310525 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:12.443310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-cf802847-201a-45d7-b31c-48308f22e526 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:12.452010 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-cf802847-201a-45d7-b31c-48308f22e526 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:12.453644 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-cf802847-201a-45d7-b31c-48308f22e526 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:12.454798 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-cf802847-201a-45d7-b31c-48308f22e526 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.160031 Jun 22 10:27:12.455363 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 459/924] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:12 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:13.473215 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-467ec74b-edbe-45f0-b0c0-dfd114fe13c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:13.473795 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-467ec74b-edbe-45f0-b0c0-dfd114fe13c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:13.480656 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-467ec74b-edbe-45f0-b0c0-dfd114fe13c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:13.481127 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-467ec74b-edbe-45f0-b0c0-dfd114fe13c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:13.481883 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-467ec74b-edbe-45f0-b0c0-dfd114fe13c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:13.482337 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-467ec74b-edbe-45f0-b0c0-dfd114fe13c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:13.609146 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-467ec74b-edbe-45f0-b0c0-dfd114fe13c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:13.617050 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-467ec74b-edbe-45f0-b0c0-dfd114fe13c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:13.618550 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-467ec74b-edbe-45f0-b0c0-dfd114fe13c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:13.619708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-467ec74b-edbe-45f0-b0c0-dfd114fe13c9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.150430 Jun 22 10:27:13.620264 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 466/925] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:13 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:14.639229 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-aef89a42-8c77-4206-9ac9-237126888ce0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:14.639821 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-aef89a42-8c77-4206-9ac9-237126888ce0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:14.646650 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aef89a42-8c77-4206-9ac9-237126888ce0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:14.647089 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aef89a42-8c77-4206-9ac9-237126888ce0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:14.647836 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aef89a42-8c77-4206-9ac9-237126888ce0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:14.648261 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aef89a42-8c77-4206-9ac9-237126888ce0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:14.784157 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-aef89a42-8c77-4206-9ac9-237126888ce0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:14.792258 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-aef89a42-8c77-4206-9ac9-237126888ce0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:14.793767 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-aef89a42-8c77-4206-9ac9-237126888ce0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:14.795462 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-aef89a42-8c77-4206-9ac9-237126888ce0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.161022 Jun 22 10:27:14.796015 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 460/926] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:14 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:15.814545 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c185fb6a-56e9-49fa-ae9a-a3998fb591d5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:15.815185 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c185fb6a-56e9-49fa-ae9a-a3998fb591d5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:15.822144 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c185fb6a-56e9-49fa-ae9a-a3998fb591d5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:15.822595 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c185fb6a-56e9-49fa-ae9a-a3998fb591d5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:15.823368 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c185fb6a-56e9-49fa-ae9a-a3998fb591d5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:15.823806 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c185fb6a-56e9-49fa-ae9a-a3998fb591d5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:15.955968 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c185fb6a-56e9-49fa-ae9a-a3998fb591d5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:15.963970 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c185fb6a-56e9-49fa-ae9a-a3998fb591d5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:15.965518 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c185fb6a-56e9-49fa-ae9a-a3998fb591d5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:15.966717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c185fb6a-56e9-49fa-ae9a-a3998fb591d5 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.156612 Jun 22 10:27:15.967270 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 467/927] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:15 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:16.985234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f3a8e298-b8d2-4e0a-b74b-13d6971ad6ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:16.985842 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f3a8e298-b8d2-4e0a-b74b-13d6971ad6ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:16.992539 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f3a8e298-b8d2-4e0a-b74b-13d6971ad6ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:16.993020 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f3a8e298-b8d2-4e0a-b74b-13d6971ad6ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:16.993784 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f3a8e298-b8d2-4e0a-b74b-13d6971ad6ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:16.994221 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f3a8e298-b8d2-4e0a-b74b-13d6971ad6ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:17.127696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f3a8e298-b8d2-4e0a-b74b-13d6971ad6ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:17.135734 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f3a8e298-b8d2-4e0a-b74b-13d6971ad6ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:17.137270 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f3a8e298-b8d2-4e0a-b74b-13d6971ad6ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:17.138423 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f3a8e298-b8d2-4e0a-b74b-13d6971ad6ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1743 microversion: 2.20 time: 0.157600 Jun 22 10:27:17.138979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 461/928] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:16 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:18.156663 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-aa644c4a-cc59-4276-8e50-186266f3ee9d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:18.157306 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-aa644c4a-cc59-4276-8e50-186266f3ee9d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:18.164169 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-aa644c4a-cc59-4276-8e50-186266f3ee9d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:18.164622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-aa644c4a-cc59-4276-8e50-186266f3ee9d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:18.165501 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-aa644c4a-cc59-4276-8e50-186266f3ee9d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:18.165944 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-aa644c4a-cc59-4276-8e50-186266f3ee9d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:18.296295 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-aa644c4a-cc59-4276-8e50-186266f3ee9d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:18.304338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-aa644c4a-cc59-4276-8e50-186266f3ee9d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:18.307977 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-aa644c4a-cc59-4276-8e50-186266f3ee9d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:18.307977 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-aa644c4a-cc59-4276-8e50-186266f3ee9d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1743 microversion: 2.20 time: 0.154317 Jun 22 10:27:18.307977 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 468/929] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:18 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:19.326385 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2d90a705-008e-4735-a06f-b697868b46fe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:19.326991 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2d90a705-008e-4735-a06f-b697868b46fe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:19.333045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d90a705-008e-4735-a06f-b697868b46fe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:19.333497 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d90a705-008e-4735-a06f-b697868b46fe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:19.334254 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d90a705-008e-4735-a06f-b697868b46fe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:19.334690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d90a705-008e-4735-a06f-b697868b46fe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:19.465155 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2d90a705-008e-4735-a06f-b697868b46fe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:19.473103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2d90a705-008e-4735-a06f-b697868b46fe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:19.474751 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2d90a705-008e-4735-a06f-b697868b46fe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:19.475886 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2d90a705-008e-4735-a06f-b697868b46fe tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1743 microversion: 2.20 time: 0.154109 Jun 22 10:27:19.476439 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 462/930] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:19 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:20.493205 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0afe575b-9313-4156-8a80-852714120782 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:20.493724 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0afe575b-9313-4156-8a80-852714120782 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:20.500945 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0afe575b-9313-4156-8a80-852714120782 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:20.501401 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0afe575b-9313-4156-8a80-852714120782 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:20.502170 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0afe575b-9313-4156-8a80-852714120782 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:20.502610 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0afe575b-9313-4156-8a80-852714120782 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:20.633031 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0afe575b-9313-4156-8a80-852714120782 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:20.641043 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0afe575b-9313-4156-8a80-852714120782 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:20.642551 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0afe575b-9313-4156-8a80-852714120782 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:20.643715 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0afe575b-9313-4156-8a80-852714120782 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1743 microversion: 2.20 time: 0.154551 Jun 22 10:27:20.644277 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 469/931] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:20 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:20.850038 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-0630119b-5f6d-446a-96fa-f406469508e0 req-46c0710b-051a-4d85-ac31-414d103ddc8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e", "name": "network-vif-plugged", "status": "completed", "tag": "dbfaa146-96f3-4722-9a6e-f6764ddb4ef2"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:20.859291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-0630119b-5f6d-446a-96fa-f406469508e0 req-46c0710b-051a-4d85-ac31-414d103ddc8f service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:20.859738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-0630119b-5f6d-446a-96fa-f406469508e0 req-46c0710b-051a-4d85-ac31-414d103ddc8f service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:20.870750 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-0630119b-5f6d-446a-96fa-f406469508e0 req-46c0710b-051a-4d85-ac31-414d103ddc8f service nova] Creating event network-vif-plugged:dbfaa146-96f3-4722-9a6e-f6764ddb4ef2 for instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e on hv-cinder-84327 Jun 22 10:27:20.875730 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-0630119b-5f6d-446a-96fa-f406469508e0 req-46c0710b-051a-4d85-ac31-414d103ddc8f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029415 Jun 22 10:27:20.876310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 463/932] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:21.661882 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-af170a5b-b4ed-4788-bb28-05807aa9289e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:21.662487 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-af170a5b-b4ed-4788-bb28-05807aa9289e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:21.664794 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:21.669731 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-af170a5b-b4ed-4788-bb28-05807aa9289e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:21.670175 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-af170a5b-b4ed-4788-bb28-05807aa9289e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:21.670940 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-af170a5b-b4ed-4788-bb28-05807aa9289e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:21.671374 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-af170a5b-b4ed-4788-bb28-05807aa9289e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:21.800798 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-af170a5b-b4ed-4788-bb28-05807aa9289e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:21.808809 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-af170a5b-b4ed-4788-bb28-05807aa9289e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:21.810849 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-af170a5b-b4ed-4788-bb28-05807aa9289e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:21.812044 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-af170a5b-b4ed-4788-bb28-05807aa9289e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1743 microversion: 2.20 time: 0.154468 Jun 22 10:27:21.812595 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 470/933] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:21 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:22.831535 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e570390f-39e9-4e61-a8b4-28c826e233c0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:22.832229 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e570390f-39e9-4e61-a8b4-28c826e233c0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:22.838482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e570390f-39e9-4e61-a8b4-28c826e233c0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:22.838931 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e570390f-39e9-4e61-a8b4-28c826e233c0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:22.839700 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e570390f-39e9-4e61-a8b4-28c826e233c0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:22.840132 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e570390f-39e9-4e61-a8b4-28c826e233c0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:22.977365 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e570390f-39e9-4e61-a8b4-28c826e233c0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:22.985494 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e570390f-39e9-4e61-a8b4-28c826e233c0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:22.987002 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e570390f-39e9-4e61-a8b4-28c826e233c0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:22.988161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e570390f-39e9-4e61-a8b4-28c826e233c0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1743 microversion: 2.20 time: 0.161384 Jun 22 10:27:22.988748 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 464/934] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:22 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:24.007026 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9bbf57ca-bc5e-41d4-94a2-33f7c2848123 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:24.007794 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9bbf57ca-bc5e-41d4-94a2-33f7c2848123 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:24.014877 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9bbf57ca-bc5e-41d4-94a2-33f7c2848123 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:24.015334 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9bbf57ca-bc5e-41d4-94a2-33f7c2848123 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:24.016112 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9bbf57ca-bc5e-41d4-94a2-33f7c2848123 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:24.016553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9bbf57ca-bc5e-41d4-94a2-33f7c2848123 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:24.145532 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9bbf57ca-bc5e-41d4-94a2-33f7c2848123 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:24.153765 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9bbf57ca-bc5e-41d4-94a2-33f7c2848123 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:24.155358 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9bbf57ca-bc5e-41d4-94a2-33f7c2848123 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:24.156511 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9bbf57ca-bc5e-41d4-94a2-33f7c2848123 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1738 microversion: 2.20 time: 0.153512 Jun 22 10:27:24.157116 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 471/935] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:24 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:27:25.175750 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-248f42c9-04c1-4a53-a49d-39c3999d829e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:25.176661 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-248f42c9-04c1-4a53-a49d-39c3999d829e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:25.184709 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-248f42c9-04c1-4a53-a49d-39c3999d829e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:25.185596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-248f42c9-04c1-4a53-a49d-39c3999d829e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:25.186461 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-248f42c9-04c1-4a53-a49d-39c3999d829e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:25.187906 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-248f42c9-04c1-4a53-a49d-39c3999d829e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:25.334439 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-248f42c9-04c1-4a53-a49d-39c3999d829e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:25.343791 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-248f42c9-04c1-4a53-a49d-39c3999d829e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:25.345325 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-248f42c9-04c1-4a53-a49d-39c3999d829e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:25.346521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-248f42c9-04c1-4a53-a49d-39c3999d829e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1738 microversion: 2.20 time: 0.174790 Jun 22 10:27:25.347073 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 465/936] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:25 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:26.370174 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d13e9180-0872-42be-8fa6-ce55356829d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:26.370796 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d13e9180-0872-42be-8fa6-ce55356829d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:26.379117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d13e9180-0872-42be-8fa6-ce55356829d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:26.379564 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d13e9180-0872-42be-8fa6-ce55356829d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:26.380568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d13e9180-0872-42be-8fa6-ce55356829d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:26.381313 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d13e9180-0872-42be-8fa6-ce55356829d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:26.536608 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d13e9180-0872-42be-8fa6-ce55356829d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:26.545632 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d13e9180-0872-42be-8fa6-ce55356829d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:26.547165 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d13e9180-0872-42be-8fa6-ce55356829d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:26.548329 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d13e9180-0872-42be-8fa6-ce55356829d3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1738 microversion: 2.20 time: 0.182559 Jun 22 10:27:26.548912 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 472/937] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:26 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:27.570330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-69407411-7432-4133-9797-bf772056c948 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:27.570964 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-69407411-7432-4133-9797-bf772056c948 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:27.578678 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-69407411-7432-4133-9797-bf772056c948 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:27.579130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-69407411-7432-4133-9797-bf772056c948 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:27.579904 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-69407411-7432-4133-9797-bf772056c948 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:27.580370 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-69407411-7432-4133-9797-bf772056c948 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:27.718113 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-69407411-7432-4133-9797-bf772056c948 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:27.726114 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-69407411-7432-4133-9797-bf772056c948 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:27.727618 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-69407411-7432-4133-9797-bf772056c948 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:27.728898 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-69407411-7432-4133-9797-bf772056c948 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1738 microversion: 2.20 time: 0.162944 Jun 22 10:27:27.729672 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 466/938] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:27 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:28.748269 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-dff173ff-668a-4619-b07c-aadf8cc44062 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:28.749668 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-dff173ff-668a-4619-b07c-aadf8cc44062 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:28.757103 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dff173ff-668a-4619-b07c-aadf8cc44062 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:28.757643 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dff173ff-668a-4619-b07c-aadf8cc44062 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:28.758820 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dff173ff-668a-4619-b07c-aadf8cc44062 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:28.759479 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dff173ff-668a-4619-b07c-aadf8cc44062 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:28.925341 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-dff173ff-668a-4619-b07c-aadf8cc44062 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:28.936667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-dff173ff-668a-4619-b07c-aadf8cc44062 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:28.951090 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-dff173ff-668a-4619-b07c-aadf8cc44062 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:28.951090 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-dff173ff-668a-4619-b07c-aadf8cc44062 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1738 microversion: 2.20 time: 0.195560 Jun 22 10:27:28.951090 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 473/939] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:28 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:29.960333 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5907d714-7328-4d4f-9502-d563ff1c266b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:29.960931 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5907d714-7328-4d4f-9502-d563ff1c266b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:29.969602 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5907d714-7328-4d4f-9502-d563ff1c266b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:29.970456 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5907d714-7328-4d4f-9502-d563ff1c266b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:29.971543 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5907d714-7328-4d4f-9502-d563ff1c266b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:29.972222 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5907d714-7328-4d4f-9502-d563ff1c266b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:30.127811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5907d714-7328-4d4f-9502-d563ff1c266b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:30.143392 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5907d714-7328-4d4f-9502-d563ff1c266b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:30.145208 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5907d714-7328-4d4f-9502-d563ff1c266b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:30.146401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5907d714-7328-4d4f-9502-d563ff1c266b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1738 microversion: 2.20 time: 0.191552 Jun 22 10:27:30.147337 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 467/940] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:29 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:31.167128 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-682b48b0-cf0d-49fd-ac2c-50ac4962ffde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:31.167733 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-682b48b0-cf0d-49fd-ac2c-50ac4962ffde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:31.174433 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-682b48b0-cf0d-49fd-ac2c-50ac4962ffde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:31.174890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-682b48b0-cf0d-49fd-ac2c-50ac4962ffde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:31.175682 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-682b48b0-cf0d-49fd-ac2c-50ac4962ffde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:31.176109 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-682b48b0-cf0d-49fd-ac2c-50ac4962ffde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:31.326744 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-682b48b0-cf0d-49fd-ac2c-50ac4962ffde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:31.335360 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-682b48b0-cf0d-49fd-ac2c-50ac4962ffde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:31.336897 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-682b48b0-cf0d-49fd-ac2c-50ac4962ffde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:31.338068 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-682b48b0-cf0d-49fd-ac2c-50ac4962ffde tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1738 microversion: 2.20 time: 0.175130 Jun 22 10:27:31.338703 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 474/941] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:31 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:32.357355 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e21b9114-0c76-47e7-8a21-3733f4cfe296 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:32.358063 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e21b9114-0c76-47e7-8a21-3733f4cfe296 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:32.365166 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e21b9114-0c76-47e7-8a21-3733f4cfe296 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:32.365628 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e21b9114-0c76-47e7-8a21-3733f4cfe296 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:32.366422 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e21b9114-0c76-47e7-8a21-3733f4cfe296 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:32.367056 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e21b9114-0c76-47e7-8a21-3733f4cfe296 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:32.511491 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e21b9114-0c76-47e7-8a21-3733f4cfe296 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:32.520522 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e21b9114-0c76-47e7-8a21-3733f4cfe296 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:32.522108 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e21b9114-0c76-47e7-8a21-3733f4cfe296 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:32.523399 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e21b9114-0c76-47e7-8a21-3733f4cfe296 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1738 microversion: 2.20 time: 0.170611 Jun 22 10:27:32.523957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 468/942] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:32 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:33.545420 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4e02cdd7-5df8-4863-b356-fcf5412f37b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:33.546027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4e02cdd7-5df8-4863-b356-fcf5412f37b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:33.552683 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4e02cdd7-5df8-4863-b356-fcf5412f37b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:33.553181 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4e02cdd7-5df8-4863-b356-fcf5412f37b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:33.553942 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4e02cdd7-5df8-4863-b356-fcf5412f37b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:33.554374 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4e02cdd7-5df8-4863-b356-fcf5412f37b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:33.704199 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4e02cdd7-5df8-4863-b356-fcf5412f37b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:33.712708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4e02cdd7-5df8-4863-b356-fcf5412f37b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:33.714480 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4e02cdd7-5df8-4863-b356-fcf5412f37b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:33.715680 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4e02cdd7-5df8-4863-b356-fcf5412f37b0 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1738 microversion: 2.20 time: 0.174279 Jun 22 10:27:33.729581 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 475/943] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:33 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:34.740246 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b5965fb7-1046-4e9c-9fd1-6bed10c82c37 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:34.741562 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b5965fb7-1046-4e9c-9fd1-6bed10c82c37 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:34.749387 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b5965fb7-1046-4e9c-9fd1-6bed10c82c37 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:34.750389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b5965fb7-1046-4e9c-9fd1-6bed10c82c37 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:34.751453 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b5965fb7-1046-4e9c-9fd1-6bed10c82c37 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:34.752121 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b5965fb7-1046-4e9c-9fd1-6bed10c82c37 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:34.905750 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b5965fb7-1046-4e9c-9fd1-6bed10c82c37 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:34.916004 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b5965fb7-1046-4e9c-9fd1-6bed10c82c37 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:34.918334 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b5965fb7-1046-4e9c-9fd1-6bed10c82c37 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:34.919414 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b5965fb7-1046-4e9c-9fd1-6bed10c82c37 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1738 microversion: 2.20 time: 0.183710 Jun 22 10:27:34.921086 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 469/944] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:34 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:35.940981 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a12dd9f4-84e0-4c4f-8dbf-fa4bd6f63051 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:35.942283 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a12dd9f4-84e0-4c4f-8dbf-fa4bd6f63051 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:35.949283 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a12dd9f4-84e0-4c4f-8dbf-fa4bd6f63051 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:35.949814 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a12dd9f4-84e0-4c4f-8dbf-fa4bd6f63051 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:35.950829 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a12dd9f4-84e0-4c4f-8dbf-fa4bd6f63051 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:35.951426 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a12dd9f4-84e0-4c4f-8dbf-fa4bd6f63051 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:36.098076 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a12dd9f4-84e0-4c4f-8dbf-fa4bd6f63051 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:36.107589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a12dd9f4-84e0-4c4f-8dbf-fa4bd6f63051 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:36.109144 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a12dd9f4-84e0-4c4f-8dbf-fa4bd6f63051 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:36.110498 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a12dd9f4-84e0-4c4f-8dbf-fa4bd6f63051 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1738 microversion: 2.20 time: 0.176219 Jun 22 10:27:36.111035 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 476/945] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:35 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:37.129201 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-11755a3e-1353-4683-ba88-939cf0099249 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:37.129833 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-11755a3e-1353-4683-ba88-939cf0099249 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:37.136334 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-11755a3e-1353-4683-ba88-939cf0099249 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:37.136778 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-11755a3e-1353-4683-ba88-939cf0099249 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:37.137596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-11755a3e-1353-4683-ba88-939cf0099249 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:37.138032 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-11755a3e-1353-4683-ba88-939cf0099249 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:37.266253 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-11755a3e-1353-4683-ba88-939cf0099249 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:37.274107 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-11755a3e-1353-4683-ba88-939cf0099249 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:37.275603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-11755a3e-1353-4683-ba88-939cf0099249 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:37.276746 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-11755a3e-1353-4683-ba88-939cf0099249 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1738 microversion: 2.20 time: 0.151533 Jun 22 10:27:37.277332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 470/946] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:37 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:38.295477 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6bb10957-e732-494c-b5db-c15613fdf35d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:38.297070 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6bb10957-e732-494c-b5db-c15613fdf35d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:38.303589 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6bb10957-e732-494c-b5db-c15613fdf35d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.304043 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6bb10957-e732-494c-b5db-c15613fdf35d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.304852 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6bb10957-e732-494c-b5db-c15613fdf35d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.305286 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6bb10957-e732-494c-b5db-c15613fdf35d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.444033 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6bb10957-e732-494c-b5db-c15613fdf35d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:38.452276 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6bb10957-e732-494c-b5db-c15613fdf35d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:38.453781 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6bb10957-e732-494c-b5db-c15613fdf35d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:38.454928 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6bb10957-e732-494c-b5db-c15613fdf35d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1720 microversion: 2.20 time: 0.163315 Jun 22 10:27:38.455481 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 477/947] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:38 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:39.473716 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b1c09a24-1254-4ed5-8929-d4139d6cdd38 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:39.474319 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b1c09a24-1254-4ed5-8929-d4139d6cdd38 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:39.480911 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b1c09a24-1254-4ed5-8929-d4139d6cdd38 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:39.481363 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b1c09a24-1254-4ed5-8929-d4139d6cdd38 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:39.482124 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b1c09a24-1254-4ed5-8929-d4139d6cdd38 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:39.482561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b1c09a24-1254-4ed5-8929-d4139d6cdd38 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:39.607727 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b1c09a24-1254-4ed5-8929-d4139d6cdd38 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:39.615638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b1c09a24-1254-4ed5-8929-d4139d6cdd38 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:39.617165 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b1c09a24-1254-4ed5-8929-d4139d6cdd38 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:39.618316 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b1c09a24-1254-4ed5-8929-d4139d6cdd38 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1720 microversion: 2.20 time: 0.148570 Jun 22 10:27:39.618874 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 471/948] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:39 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:40.639889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5e50c40c-4a2b-4998-9786-5e85197d3a27 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:40.640677 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5e50c40c-4a2b-4998-9786-5e85197d3a27 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:40.646894 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5e50c40c-4a2b-4998-9786-5e85197d3a27 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:40.647336 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5e50c40c-4a2b-4998-9786-5e85197d3a27 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:40.648090 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5e50c40c-4a2b-4998-9786-5e85197d3a27 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:40.648519 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5e50c40c-4a2b-4998-9786-5e85197d3a27 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:40.780965 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5e50c40c-4a2b-4998-9786-5e85197d3a27 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:40.789366 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5e50c40c-4a2b-4998-9786-5e85197d3a27 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:40.790868 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5e50c40c-4a2b-4998-9786-5e85197d3a27 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:40.792018 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5e50c40c-4a2b-4998-9786-5e85197d3a27 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1723 microversion: 2.20 time: 0.156601 Jun 22 10:27:40.792580 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 478/949] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:40 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:40.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6d4b4d0b-8a01-455a-b806-8f3ebc51f8f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19fede19-8289-4536-9a2b-3978bf002a8f"}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:40.810598 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6d4b4d0b-8a01-455a-b806-8f3ebc51f8f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:40.817245 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6d4b4d0b-8a01-455a-b806-8f3ebc51f8f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:40.817668 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6d4b4d0b-8a01-455a-b806-8f3ebc51f8f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:40.818432 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6d4b4d0b-8a01-455a-b806-8f3ebc51f8f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:40.818862 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6d4b4d0b-8a01-455a-b806-8f3ebc51f8f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:41.993954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6d4b4d0b-8a01-455a-b806-8f3ebc51f8f1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "POST /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.188396 Jun 22 10:27:41.994573 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 472/950] 10.222.0.46 () {62 vars in 1363 bytes} [Wed Jun 22 10:27:40 2022] POST /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/os-volume_attachments => generated 188 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:27:42.113807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8731a69a-8ba6-46c0-9c3d-e0b84d21917a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:42.114374 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8731a69a-8ba6-46c0-9c3d-e0b84d21917a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:42.120845 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8731a69a-8ba6-46c0-9c3d-e0b84d21917a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:42.121302 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8731a69a-8ba6-46c0-9c3d-e0b84d21917a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:42.122077 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8731a69a-8ba6-46c0-9c3d-e0b84d21917a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:42.122486 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8731a69a-8ba6-46c0-9c3d-e0b84d21917a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:42.692028 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:42.787341 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-8731a69a-8ba6-46c0-9c3d-e0b84d21917a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "DELETE /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/os-volume_attachments/19fede19-8289-4536-9a2b-3978bf002a8f" status: 202 len: 0 microversion: 2.20 time: 0.677560 Jun 22 10:27:42.787944 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 479/951] 10.222.0.46 () {60 vars in 1456 bytes} [Wed Jun 22 10:27:42 2022] DELETE /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/os-volume_attachments/19fede19-8289-4536-9a2b-3978bf002a8f => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:27:42.843674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d89c7cf4-d1e1-4858-b139-c3a35d0b7d45 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:42.844246 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d89c7cf4-d1e1-4858-b139-c3a35d0b7d45 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:42.846685 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=30 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:42.851508 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d89c7cf4-d1e1-4858-b139-c3a35d0b7d45 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:42.851957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d89c7cf4-d1e1-4858-b139-c3a35d0b7d45 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:42.852734 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d89c7cf4-d1e1-4858-b139-c3a35d0b7d45 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:42.853195 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d89c7cf4-d1e1-4858-b139-c3a35d0b7d45 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:42.889258 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:42.938458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-076a5bb6-bab3-4ea4-95aa-0c601a235c75 req-198fa54c-3ace-495d-8a90-7c4b024ee188 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e", "name": "network-vif-unplugged", "status": "completed", "tag": "dbfaa146-96f3-4722-9a6e-f6764ddb4ef2"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:42.950712 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-076a5bb6-bab3-4ea4-95aa-0c601a235c75 req-198fa54c-3ace-495d-8a90-7c4b024ee188 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:42.951164 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-076a5bb6-bab3-4ea4-95aa-0c601a235c75 req-198fa54c-3ace-495d-8a90-7c4b024ee188 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:42.963423 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.compute.server_external_events [req-076a5bb6-bab3-4ea4-95aa-0c601a235c75 req-198fa54c-3ace-495d-8a90-7c4b024ee188 service nova] Unable to find a host for instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e. Dropping event network-vif-unplugged {{(pid=118327) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 10:27:42.965163 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-076a5bb6-bab3-4ea4-95aa-0c601a235c75 req-198fa54c-3ace-495d-8a90-7c4b024ee188 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031832 Jun 22 10:27:42.965521 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 480/952] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 22 10:27:43.276346 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d89c7cf4-d1e1-4858-b139-c3a35d0b7d45 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "POST /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/action" status: 202 len: 0 microversion: 2.20 time: 0.436294 Jun 22 10:27:43.277204 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 473/953] 10.222.0.46 () {62 vars in 1318 bytes} [Wed Jun 22 10:27:42 2022] POST /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:27:43.286401 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-976d9631-1174-4f13-ab2e-08faaefce8a8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:43.291877 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-976d9631-1174-4f13-ab2e-08faaefce8a8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:43.294454 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-976d9631-1174-4f13-ab2e-08faaefce8a8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:43.295138 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-976d9631-1174-4f13-ab2e-08faaefce8a8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:43.296182 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-976d9631-1174-4f13-ab2e-08faaefce8a8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:43.296782 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-976d9631-1174-4f13-ab2e-08faaefce8a8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:43.456692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-976d9631-1174-4f13-ab2e-08faaefce8a8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:43.456692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-976d9631-1174-4f13-ab2e-08faaefce8a8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:43.457895 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-976d9631-1174-4f13-ab2e-08faaefce8a8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:43.457895 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-976d9631-1174-4f13-ab2e-08faaefce8a8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1671 microversion: 2.20 time: 0.164913 Jun 22 10:27:43.457895 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 481/954] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:43 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:44.467208 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6c303102-dd3e-4918-8462-963fc266ba7e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:44.467752 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6c303102-dd3e-4918-8462-963fc266ba7e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:44.474328 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6c303102-dd3e-4918-8462-963fc266ba7e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:44.474780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6c303102-dd3e-4918-8462-963fc266ba7e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:44.475548 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6c303102-dd3e-4918-8462-963fc266ba7e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:44.475982 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6c303102-dd3e-4918-8462-963fc266ba7e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:44.608334 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6c303102-dd3e-4918-8462-963fc266ba7e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:44.616680 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6c303102-dd3e-4918-8462-963fc266ba7e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:44.618323 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6c303102-dd3e-4918-8462-963fc266ba7e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:44.619557 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6c303102-dd3e-4918-8462-963fc266ba7e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1671 microversion: 2.20 time: 0.158440 Jun 22 10:27:44.620192 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 474/955] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:44 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:45.638327 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7d557ee6-d3b3-4202-9a31-40d1cd776904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:45.638910 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7d557ee6-d3b3-4202-9a31-40d1cd776904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:45.646158 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7d557ee6-d3b3-4202-9a31-40d1cd776904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:45.646610 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7d557ee6-d3b3-4202-9a31-40d1cd776904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:45.647383 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7d557ee6-d3b3-4202-9a31-40d1cd776904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:45.647827 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7d557ee6-d3b3-4202-9a31-40d1cd776904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:45.789028 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7d557ee6-d3b3-4202-9a31-40d1cd776904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:45.797761 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7d557ee6-d3b3-4202-9a31-40d1cd776904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:45.799370 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7d557ee6-d3b3-4202-9a31-40d1cd776904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:45.800611 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7d557ee6-d3b3-4202-9a31-40d1cd776904 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.166197 Jun 22 10:27:45.801273 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 482/956] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:45 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:46.668697 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4ee71d76-027e-45f9-887b-c7bc40410955 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:46.669126 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4ee71d76-027e-45f9-887b-c7bc40410955 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:46.675544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4ee71d76-027e-45f9-887b-c7bc40410955 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:46.676001 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4ee71d76-027e-45f9-887b-c7bc40410955 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:46.676803 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4ee71d76-027e-45f9-887b-c7bc40410955 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:46.677267 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4ee71d76-027e-45f9-887b-c7bc40410955 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:46.701373 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4ee71d76-027e-45f9-887b-c7bc40410955 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/ips" status: 200 len: 144 microversion: 2.1 time: 0.036410 Jun 22 10:27:46.701805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 475/957] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jun 22 10:27:46 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:46.823503 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f84cb05b-f8d7-419d-b0bf-79eda0c9111e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:46.824291 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f84cb05b-f8d7-419d-b0bf-79eda0c9111e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:46.836305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f84cb05b-f8d7-419d-b0bf-79eda0c9111e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:46.837172 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f84cb05b-f8d7-419d-b0bf-79eda0c9111e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:46.838202 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f84cb05b-f8d7-419d-b0bf-79eda0c9111e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:46.838867 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f84cb05b-f8d7-419d-b0bf-79eda0c9111e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:47.013813 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f84cb05b-f8d7-419d-b0bf-79eda0c9111e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:47.026483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f84cb05b-f8d7-419d-b0bf-79eda0c9111e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:47.028105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f84cb05b-f8d7-419d-b0bf-79eda0c9111e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:47.029446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f84cb05b-f8d7-419d-b0bf-79eda0c9111e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.210866 Jun 22 10:27:47.040931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 483/958] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:46 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:27:48.048316 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a83db645-7145-4100-8338-0e0bbba3fd31 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:48.049302 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a83db645-7145-4100-8338-0e0bbba3fd31 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:48.056576 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a83db645-7145-4100-8338-0e0bbba3fd31 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:48.057057 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a83db645-7145-4100-8338-0e0bbba3fd31 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:48.058083 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a83db645-7145-4100-8338-0e0bbba3fd31 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:48.058455 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a83db645-7145-4100-8338-0e0bbba3fd31 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:48.193831 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a83db645-7145-4100-8338-0e0bbba3fd31 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:48.202473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a83db645-7145-4100-8338-0e0bbba3fd31 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:48.203961 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a83db645-7145-4100-8338-0e0bbba3fd31 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:48.205157 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a83db645-7145-4100-8338-0e0bbba3fd31 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.161614 Jun 22 10:27:48.205703 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 476/959] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:48 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:49.224271 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c8ca1b17-ad63-497f-a42b-3d3aad7ba373 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:49.224941 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c8ca1b17-ad63-497f-a42b-3d3aad7ba373 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:49.232106 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c8ca1b17-ad63-497f-a42b-3d3aad7ba373 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:49.232581 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c8ca1b17-ad63-497f-a42b-3d3aad7ba373 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:49.233385 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c8ca1b17-ad63-497f-a42b-3d3aad7ba373 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:49.233809 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c8ca1b17-ad63-497f-a42b-3d3aad7ba373 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:49.377964 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c8ca1b17-ad63-497f-a42b-3d3aad7ba373 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:49.386697 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c8ca1b17-ad63-497f-a42b-3d3aad7ba373 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:49.388935 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c8ca1b17-ad63-497f-a42b-3d3aad7ba373 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:49.390077 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c8ca1b17-ad63-497f-a42b-3d3aad7ba373 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.169818 Jun 22 10:27:49.391072 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 484/960] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:49 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:49.588341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4058c348-236a-4df9-8f7b-9b8bb7944dd5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75649dcb-ecac-47c4-8743-a8efc06bc5b6"}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:49.589489 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4058c348-236a-4df9-8f7b-9b8bb7944dd5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:49.596110 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4058c348-236a-4df9-8f7b-9b8bb7944dd5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:49.596566 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4058c348-236a-4df9-8f7b-9b8bb7944dd5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:49.597377 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4058c348-236a-4df9-8f7b-9b8bb7944dd5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:49.597813 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4058c348-236a-4df9-8f7b-9b8bb7944dd5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:50.407564 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4a6c2081-ca9e-4139-a715-7f17b8fb5308 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:50.408169 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4a6c2081-ca9e-4139-a715-7f17b8fb5308 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:50.415301 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4a6c2081-ca9e-4139-a715-7f17b8fb5308 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:50.415758 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4a6c2081-ca9e-4139-a715-7f17b8fb5308 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:50.416588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4a6c2081-ca9e-4139-a715-7f17b8fb5308 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:50.417070 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4a6c2081-ca9e-4139-a715-7f17b8fb5308 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:50.556293 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4a6c2081-ca9e-4139-a715-7f17b8fb5308 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:50.565424 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4a6c2081-ca9e-4139-a715-7f17b8fb5308 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:50.566935 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4a6c2081-ca9e-4139-a715-7f17b8fb5308 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:50.568105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4a6c2081-ca9e-4139-a715-7f17b8fb5308 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.164580 Jun 22 10:27:50.568667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 485/961] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:50 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:27:51.585778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4926479e-5ffc-4134-9b41-f72b9caff429 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:51.586427 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4926479e-5ffc-4134-9b41-f72b9caff429 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:51.593592 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4926479e-5ffc-4134-9b41-f72b9caff429 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:51.594046 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4926479e-5ffc-4134-9b41-f72b9caff429 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:51.594902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4926479e-5ffc-4134-9b41-f72b9caff429 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:51.595347 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4926479e-5ffc-4134-9b41-f72b9caff429 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:51.735113 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4926479e-5ffc-4134-9b41-f72b9caff429 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:51.744467 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4926479e-5ffc-4134-9b41-f72b9caff429 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:51.746284 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-4926479e-5ffc-4134-9b41-f72b9caff429 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:51.747478 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4926479e-5ffc-4134-9b41-f72b9caff429 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.165703 Jun 22 10:27:51.748259 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 486/962] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:51 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:27:52.765835 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-54b5e7fd-4579-4216-b70f-e27abd1b93e7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:52.766531 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-54b5e7fd-4579-4216-b70f-e27abd1b93e7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:52.769047 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=34 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:52.774023 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-54b5e7fd-4579-4216-b70f-e27abd1b93e7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:52.774469 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-54b5e7fd-4579-4216-b70f-e27abd1b93e7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:52.775281 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-54b5e7fd-4579-4216-b70f-e27abd1b93e7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:52.775715 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-54b5e7fd-4579-4216-b70f-e27abd1b93e7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:52.921472 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-54b5e7fd-4579-4216-b70f-e27abd1b93e7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:52.937883 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-54b5e7fd-4579-4216-b70f-e27abd1b93e7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:52.940552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-54b5e7fd-4579-4216-b70f-e27abd1b93e7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:52.943111 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-54b5e7fd-4579-4216-b70f-e27abd1b93e7 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.180827 Jun 22 10:27:52.945581 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 487/963] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:52 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:27:53.962887 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-67ef4a94-5a48-4268-885b-b6f375f5a70d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:53.963576 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-67ef4a94-5a48-4268-885b-b6f375f5a70d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:53.970371 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-67ef4a94-5a48-4268-885b-b6f375f5a70d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:53.970817 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-67ef4a94-5a48-4268-885b-b6f375f5a70d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:53.971588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-67ef4a94-5a48-4268-885b-b6f375f5a70d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:53.972024 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-67ef4a94-5a48-4268-885b-b6f375f5a70d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:54.114418 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-67ef4a94-5a48-4268-885b-b6f375f5a70d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:54.123764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-67ef4a94-5a48-4268-885b-b6f375f5a70d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:54.125274 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-67ef4a94-5a48-4268-885b-b6f375f5a70d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:54.126730 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-67ef4a94-5a48-4268-885b-b6f375f5a70d tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.167841 Jun 22 10:27:54.127325 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 488/964] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:53 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:27:55.150268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-02519f57-ea8e-4cef-a8ee-e2d61ab58e12 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:55.151556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-02519f57-ea8e-4cef-a8ee-e2d61ab58e12 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:55.163607 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-02519f57-ea8e-4cef-a8ee-e2d61ab58e12 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:55.164279 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-02519f57-ea8e-4cef-a8ee-e2d61ab58e12 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:55.165328 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-02519f57-ea8e-4cef-a8ee-e2d61ab58e12 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:55.165888 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-02519f57-ea8e-4cef-a8ee-e2d61ab58e12 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:55.309501 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-02519f57-ea8e-4cef-a8ee-e2d61ab58e12 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:55.319475 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-02519f57-ea8e-4cef-a8ee-e2d61ab58e12 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:55.321592 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-02519f57-ea8e-4cef-a8ee-e2d61ab58e12 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:55.323064 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-02519f57-ea8e-4cef-a8ee-e2d61ab58e12 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.180420 Jun 22 10:27:55.323622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 489/965] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:55 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:56.345022 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5f6efcda-e04b-44b6-8d06-253513b386e2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:56.345764 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5f6efcda-e04b-44b6-8d06-253513b386e2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:56.353677 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5f6efcda-e04b-44b6-8d06-253513b386e2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:56.354163 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5f6efcda-e04b-44b6-8d06-253513b386e2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:56.358376 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5f6efcda-e04b-44b6-8d06-253513b386e2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:56.358906 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5f6efcda-e04b-44b6-8d06-253513b386e2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:56.506132 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5f6efcda-e04b-44b6-8d06-253513b386e2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:56.515374 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5f6efcda-e04b-44b6-8d06-253513b386e2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:56.517029 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5f6efcda-e04b-44b6-8d06-253513b386e2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:56.518222 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5f6efcda-e04b-44b6-8d06-253513b386e2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.179482 Jun 22 10:27:56.518785 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 490/966] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:56 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:57.536313 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-631f0fa7-ec61-40cf-8dbc-6e7491f96291 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:57.537189 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-631f0fa7-ec61-40cf-8dbc-6e7491f96291 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:57.543465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-631f0fa7-ec61-40cf-8dbc-6e7491f96291 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:57.543916 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-631f0fa7-ec61-40cf-8dbc-6e7491f96291 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:57.545304 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-631f0fa7-ec61-40cf-8dbc-6e7491f96291 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:57.545745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-631f0fa7-ec61-40cf-8dbc-6e7491f96291 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:57.677086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-631f0fa7-ec61-40cf-8dbc-6e7491f96291 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:57.685218 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-631f0fa7-ec61-40cf-8dbc-6e7491f96291 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:57.686665 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-631f0fa7-ec61-40cf-8dbc-6e7491f96291 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:57.687827 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-631f0fa7-ec61-40cf-8dbc-6e7491f96291 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.155849 Jun 22 10:27:57.688377 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 491/967] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:57 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:27:58.706307 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5a833e23-06b2-4cbd-b0c4-16e9e91579b1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:58.706914 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5a833e23-06b2-4cbd-b0c4-16e9e91579b1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:58.713416 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5a833e23-06b2-4cbd-b0c4-16e9e91579b1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:58.713872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5a833e23-06b2-4cbd-b0c4-16e9e91579b1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:58.714640 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5a833e23-06b2-4cbd-b0c4-16e9e91579b1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:58.715086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5a833e23-06b2-4cbd-b0c4-16e9e91579b1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:58.844014 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5a833e23-06b2-4cbd-b0c4-16e9e91579b1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:58.852309 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5a833e23-06b2-4cbd-b0c4-16e9e91579b1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:58.853932 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5a833e23-06b2-4cbd-b0c4-16e9e91579b1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:58.855085 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5a833e23-06b2-4cbd-b0c4-16e9e91579b1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.152704 Jun 22 10:27:58.855649 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 492/968] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:58 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:27:59.593685 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=11 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:59.672411 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:59.873501 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e13b3aae-dcc7-43d1-9e71-235d351477d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:59.874101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e13b3aae-dcc7-43d1-9e71-235d351477d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:59.881720 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e13b3aae-dcc7-43d1-9e71-235d351477d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:59.884163 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e13b3aae-dcc7-43d1-9e71-235d351477d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:59.884163 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e13b3aae-dcc7-43d1-9e71-235d351477d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:59.884163 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e13b3aae-dcc7-43d1-9e71-235d351477d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:00.016149 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-e13b3aae-dcc7-43d1-9e71-235d351477d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:00.024095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-e13b3aae-dcc7-43d1-9e71-235d351477d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:00.025635 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-e13b3aae-dcc7-43d1-9e71-235d351477d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:00.026794 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e13b3aae-dcc7-43d1-9e71-235d351477d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.157299 Jun 22 10:28:00.027346 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 493/969] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:59 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:28:01.046246 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-50e602b8-d946-4607-b5a6-a333af6c68ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:01.046936 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-50e602b8-d946-4607-b5a6-a333af6c68ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:01.053380 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-50e602b8-d946-4607-b5a6-a333af6c68ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:01.053829 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-50e602b8-d946-4607-b5a6-a333af6c68ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:01.054596 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-50e602b8-d946-4607-b5a6-a333af6c68ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:01.055036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-50e602b8-d946-4607-b5a6-a333af6c68ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:01.187774 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-50e602b8-d946-4607-b5a6-a333af6c68ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:01.195868 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-50e602b8-d946-4607-b5a6-a333af6c68ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:01.197404 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-50e602b8-d946-4607-b5a6-a333af6c68ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:01.198599 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-50e602b8-d946-4607-b5a6-a333af6c68ad tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.156819 Jun 22 10:28:01.199162 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 494/970] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:01 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:28:02.216506 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ad391bb1-3452-4bec-ab06-a8343777822c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:02.217296 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ad391bb1-3452-4bec-ab06-a8343777822c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:02.223744 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ad391bb1-3452-4bec-ab06-a8343777822c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:02.224286 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ad391bb1-3452-4bec-ab06-a8343777822c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:02.225146 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ad391bb1-3452-4bec-ab06-a8343777822c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:02.225588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ad391bb1-3452-4bec-ab06-a8343777822c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:02.364266 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ad391bb1-3452-4bec-ab06-a8343777822c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:02.372139 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ad391bb1-3452-4bec-ab06-a8343777822c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:02.390560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ad391bb1-3452-4bec-ab06-a8343777822c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:02.390560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ad391bb1-3452-4bec-ab06-a8343777822c tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.162432 Jun 22 10:28:02.390560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 495/971] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:02 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:28:03.407154 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b9def044-fc3e-481e-a0a6-d68036c752ee tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:03.407845 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b9def044-fc3e-481e-a0a6-d68036c752ee tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:03.414625 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b9def044-fc3e-481e-a0a6-d68036c752ee tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:03.415079 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b9def044-fc3e-481e-a0a6-d68036c752ee tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:03.415847 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b9def044-fc3e-481e-a0a6-d68036c752ee tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:03.416286 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b9def044-fc3e-481e-a0a6-d68036c752ee tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:03.434434 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:03.546128 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b9def044-fc3e-481e-a0a6-d68036c752ee tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:03.554705 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b9def044-fc3e-481e-a0a6-d68036c752ee tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:03.556169 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b9def044-fc3e-481e-a0a6-d68036c752ee tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:03.557362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b9def044-fc3e-481e-a0a6-d68036c752ee tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.154162 Jun 22 10:28:03.565168 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 496/972] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:03 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:28:03.760798 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4058c348-236a-4df9-8f7b-9b8bb7944dd5 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "POST /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.160034 Jun 22 10:28:03.760798 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 477/973] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:27:49 2022] POST /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments => generated 194 bytes in 14161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:04.576187 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-faa4084f-7473-46ae-962c-54e60325ebfc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:04.576791 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-faa4084f-7473-46ae-962c-54e60325ebfc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:04.583957 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-faa4084f-7473-46ae-962c-54e60325ebfc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:04.584402 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-faa4084f-7473-46ae-962c-54e60325ebfc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:04.585185 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-faa4084f-7473-46ae-962c-54e60325ebfc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:04.585619 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-faa4084f-7473-46ae-962c-54e60325ebfc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:04.717818 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-faa4084f-7473-46ae-962c-54e60325ebfc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:04.726399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-faa4084f-7473-46ae-962c-54e60325ebfc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:04.727896 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-faa4084f-7473-46ae-962c-54e60325ebfc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:04.729063 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-faa4084f-7473-46ae-962c-54e60325ebfc tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.157189 Jun 22 10:28:04.729619 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 497/974] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:04 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:05.281145 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-c42c07be-e5ff-4a64-b340-9fd87cff317a req-593c94ee-88ee-4554-99d7-8c28f9a8b0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e", "name": "network-vif-plugged", "status": "completed", "tag": "dbfaa146-96f3-4722-9a6e-f6764ddb4ef2"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:05.290871 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-c42c07be-e5ff-4a64-b340-9fd87cff317a req-593c94ee-88ee-4554-99d7-8c28f9a8b0b1 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:05.291318 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-c42c07be-e5ff-4a64-b340-9fd87cff317a req-593c94ee-88ee-4554-99d7-8c28f9a8b0b1 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:05.302265 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-c42c07be-e5ff-4a64-b340-9fd87cff317a req-593c94ee-88ee-4554-99d7-8c28f9a8b0b1 service nova] Creating event network-vif-plugged:dbfaa146-96f3-4722-9a6e-f6764ddb4ef2 for instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e on hv-cinder-84327 Jun 22 10:28:05.307241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-c42c07be-e5ff-4a64-b340-9fd87cff317a req-593c94ee-88ee-4554-99d7-8c28f9a8b0b1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030710 Jun 22 10:28:05.307817 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 478/975] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:28:05.747750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9d9da8fc-03b8-4fcf-b429-829e93d8fe9a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:05.748290 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9d9da8fc-03b8-4fcf-b429-829e93d8fe9a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:05.754588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d9da8fc-03b8-4fcf-b429-829e93d8fe9a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:05.755037 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d9da8fc-03b8-4fcf-b429-829e93d8fe9a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:05.755809 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d9da8fc-03b8-4fcf-b429-829e93d8fe9a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:05.756242 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d9da8fc-03b8-4fcf-b429-829e93d8fe9a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:05.890842 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9d9da8fc-03b8-4fcf-b429-829e93d8fe9a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:05.901826 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9d9da8fc-03b8-4fcf-b429-829e93d8fe9a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:05.903374 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9d9da8fc-03b8-4fcf-b429-829e93d8fe9a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:05.904553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9d9da8fc-03b8-4fcf-b429-829e93d8fe9a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.161158 Jun 22 10:28:05.905151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 498/976] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:05 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:06.933921 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5f9d7e82-0932-4555-8a21-95f091f4bb2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:06.934634 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5f9d7e82-0932-4555-8a21-95f091f4bb2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:06.941386 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5f9d7e82-0932-4555-8a21-95f091f4bb2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:06.946305 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5f9d7e82-0932-4555-8a21-95f091f4bb2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:06.946305 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5f9d7e82-0932-4555-8a21-95f091f4bb2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:06.946305 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5f9d7e82-0932-4555-8a21-95f091f4bb2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:07.073730 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5f9d7e82-0932-4555-8a21-95f091f4bb2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:07.082148 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5f9d7e82-0932-4555-8a21-95f091f4bb2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:07.083671 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5f9d7e82-0932-4555-8a21-95f091f4bb2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:07.084852 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5f9d7e82-0932-4555-8a21-95f091f4bb2a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.155161 Jun 22 10:28:07.085413 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 479/977] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:06 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:08.102630 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a7e01a0a-c6d6-4d83-aab4-f45b0b4ecbf4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:08.103355 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a7e01a0a-c6d6-4d83-aab4-f45b0b4ecbf4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:08.109935 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a7e01a0a-c6d6-4d83-aab4-f45b0b4ecbf4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:08.110382 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a7e01a0a-c6d6-4d83-aab4-f45b0b4ecbf4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:08.111719 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a7e01a0a-c6d6-4d83-aab4-f45b0b4ecbf4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:08.112159 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a7e01a0a-c6d6-4d83-aab4-f45b0b4ecbf4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:08.245643 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a7e01a0a-c6d6-4d83-aab4-f45b0b4ecbf4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:08.253685 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a7e01a0a-c6d6-4d83-aab4-f45b0b4ecbf4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:08.255199 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a7e01a0a-c6d6-4d83-aab4-f45b0b4ecbf4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:08.256361 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a7e01a0a-c6d6-4d83-aab4-f45b0b4ecbf4 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1729 microversion: 2.20 time: 0.157668 Jun 22 10:28:08.256944 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 499/978] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:08 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:09.274559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c3fcc2cb-db66-4bd2-b392-79381fd01dc6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:09.275136 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c3fcc2cb-db66-4bd2-b392-79381fd01dc6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:09.281860 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c3fcc2cb-db66-4bd2-b392-79381fd01dc6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:09.282310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c3fcc2cb-db66-4bd2-b392-79381fd01dc6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:09.283635 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c3fcc2cb-db66-4bd2-b392-79381fd01dc6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:09.284074 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c3fcc2cb-db66-4bd2-b392-79381fd01dc6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:09.424975 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c3fcc2cb-db66-4bd2-b392-79381fd01dc6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:09.432888 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c3fcc2cb-db66-4bd2-b392-79381fd01dc6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:09.434403 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c3fcc2cb-db66-4bd2-b392-79381fd01dc6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:09.435566 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c3fcc2cb-db66-4bd2-b392-79381fd01dc6 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1716 microversion: 2.20 time: 0.165044 Jun 22 10:28:09.436120 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 480/979] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:09 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1716 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:11.251632 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-131f3b0f-fbc3-4c45-b5c6-8b1763fd077c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:11.252631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-131f3b0f-fbc3-4c45-b5c6-8b1763fd077c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:11.259680 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-131f3b0f-fbc3-4c45-b5c6-8b1763fd077c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:11.260155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-131f3b0f-fbc3-4c45-b5c6-8b1763fd077c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:11.260978 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-131f3b0f-fbc3-4c45-b5c6-8b1763fd077c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:11.261404 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-131f3b0f-fbc3-4c45-b5c6-8b1763fd077c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:11.291776 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-131f3b0f-fbc3-4c45-b5c6-8b1763fd077c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Jun 22 10:28:11.292344 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 500/980] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:28:11 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:11.302505 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-98b2ea5c-7a27-41fd-af80-6ad6408a89cb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:11.303011 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-98b2ea5c-7a27-41fd-af80-6ad6408a89cb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:11.309544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-98b2ea5c-7a27-41fd-af80-6ad6408a89cb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:11.309986 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-98b2ea5c-7a27-41fd-af80-6ad6408a89cb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:11.310753 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-98b2ea5c-7a27-41fd-af80-6ad6408a89cb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:11.311178 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-98b2ea5c-7a27-41fd-af80-6ad6408a89cb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:11.339364 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-98b2ea5c-7a27-41fd-af80-6ad6408a89cb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments/75649dcb-ecac-47c4-8743-a8efc06bc5b6" status: 200 len: 194 microversion: 2.1 time: 0.040950 Jun 22 10:28:11.339953 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 481/981] 10.222.0.46 () {58 vars in 1412 bytes} [Wed Jun 22 10:28:11 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments/75649dcb-ecac-47c4-8743-a8efc06bc5b6 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:13.005885 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b77c6f23-fcd7-4e8b-8cee-b5f19afac3f4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9722e48f-87fc-44dd-8f15-6fc026e524ed"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:13.007014 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b77c6f23-fcd7-4e8b-8cee-b5f19afac3f4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:13.013580 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b77c6f23-fcd7-4e8b-8cee-b5f19afac3f4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:13.014032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b77c6f23-fcd7-4e8b-8cee-b5f19afac3f4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:13.014801 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b77c6f23-fcd7-4e8b-8cee-b5f19afac3f4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:13.015245 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b77c6f23-fcd7-4e8b-8cee-b5f19afac3f4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:14.226506 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b77c6f23-fcd7-4e8b-8cee-b5f19afac3f4 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "POST /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.224732 Jun 22 10:28:14.227326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 501/982] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:28:13 2022] POST /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments => generated 194 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:16.703831 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bd42e0cd-eb23-48d7-b4c1-52c791b40f04 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:16.704428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bd42e0cd-eb23-48d7-b4c1-52c791b40f04 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:16.710944 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bd42e0cd-eb23-48d7-b4c1-52c791b40f04 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:16.711397 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bd42e0cd-eb23-48d7-b4c1-52c791b40f04 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:16.712257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bd42e0cd-eb23-48d7-b4c1-52c791b40f04 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:16.712600 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bd42e0cd-eb23-48d7-b4c1-52c791b40f04 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:16.735126 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bd42e0cd-eb23-48d7-b4c1-52c791b40f04 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/ips" status: 200 len: 148 microversion: 2.1 time: 0.035206 Jun 22 10:28:16.736225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 482/983] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jun 22 10:28:16 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:18.651308 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-96e8c369-dbce-47ae-9e1e-78fb29d433fc tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffe84785-e866-4753-95d2-951cc9a14801"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:18.652493 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-96e8c369-dbce-47ae-9e1e-78fb29d433fc tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:18.659178 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-96e8c369-dbce-47ae-9e1e-78fb29d433fc tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:18.659876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-96e8c369-dbce-47ae-9e1e-78fb29d433fc tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:18.660638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-96e8c369-dbce-47ae-9e1e-78fb29d433fc tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:18.661119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-96e8c369-dbce-47ae-9e1e-78fb29d433fc tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:19.660436 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-96e8c369-dbce-47ae-9e1e-78fb29d433fc tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.013228 Jun 22 10:28:19.661397 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 502/984] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:28:18 2022] POST /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/os-volume_attachments => generated 194 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:22.770656 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e797ed00-540b-4e4b-b90a-9c2e4292e393 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:22.771614 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e797ed00-540b-4e4b-b90a-9c2e4292e393 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:22.778293 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e797ed00-540b-4e4b-b90a-9c2e4292e393 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.778742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e797ed00-540b-4e4b-b90a-9c2e4292e393 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.779514 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e797ed00-540b-4e4b-b90a-9c2e4292e393 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.779954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e797ed00-540b-4e4b-b90a-9c2e4292e393 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.810148 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e797ed00-540b-4e4b-b90a-9c2e4292e393 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043341 Jun 22 10:28:22.810712 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 483/985] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:28:22 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:28:22.951775 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b21a3566-be6e-4201-bd2b-b395a79e11e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:22.952505 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b21a3566-be6e-4201-bd2b-b395a79e11e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:22.955732 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=32 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:22.960785 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b21a3566-be6e-4201-bd2b-b395a79e11e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.961267 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b21a3566-be6e-4201-bd2b-b395a79e11e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.962157 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b21a3566-be6e-4201-bd2b-b395a79e11e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.962611 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b21a3566-be6e-4201-bd2b-b395a79e11e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.991763 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b21a3566-be6e-4201-bd2b-b395a79e11e9 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments/75649dcb-ecac-47c4-8743-a8efc06bc5b6" status: 200 len: 194 microversion: 2.1 time: 0.044497 Jun 22 10:28:22.995071 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 503/986] 10.222.0.46 () {58 vars in 1412 bytes} [Wed Jun 22 10:28:22 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments/75649dcb-ecac-47c4-8743-a8efc06bc5b6 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:23.002584 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9a1cac9d-a970-4ee5-88bc-8d6f4dd81459 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:23.003084 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9a1cac9d-a970-4ee5-88bc-8d6f4dd81459 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:23.009473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9a1cac9d-a970-4ee5-88bc-8d6f4dd81459 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:23.009924 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9a1cac9d-a970-4ee5-88bc-8d6f4dd81459 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:23.010696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9a1cac9d-a970-4ee5-88bc-8d6f4dd81459 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:23.011137 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9a1cac9d-a970-4ee5-88bc-8d6f4dd81459 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:23.149779 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-9a1cac9d-a970-4ee5-88bc-8d6f4dd81459 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lazy-loading 'services' on Instance uuid b9708aae-3c6d-424c-b082-97d46349a712 {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:28:23.404669 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9a1cac9d-a970-4ee5-88bc-8d6f4dd81459 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments/75649dcb-ecac-47c4-8743-a8efc06bc5b6" status: 202 len: 0 microversion: 2.1 time: 0.406155 Jun 22 10:28:23.405209 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 484/987] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jun 22 10:28:22 2022] DELETE /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments/75649dcb-ecac-47c4-8743-a8efc06bc5b6 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:28:29.279326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-108e9bf9-d1fb-4f17-90ad-a6d177c9b528 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: .version_select at 0x7f021fbe1670>, body: {"keypair": {"name": "tempest-keypair-1683073988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXHTAAxpfGtA8uiIpSFUNI/JlqC0meKZOMbaZRcfarezy5gGMaEzkoodR0t1MZnthThkUNe2Rt27fGNU8RognuMrrTYHu64Vbuk/36Wxl8FcFlvDN9DXCnwqNW2XhVYrg=="}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:29.294666 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-108e9bf9-d1fb-4f17-90ad-a6d177c9b528 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for project 347c4ccbcb464091b8254475babf2874. Resources: {'key_pairs'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:28:29.298942 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-108e9bf9-d1fb-4f17-90ad-a6d177c9b528 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for user 082ece6ea4244242a6ba99152572c80f and project 347c4ccbcb464091b8254475babf2874. Resources: {'key_pairs'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:28:29.392843 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-108e9bf9-d1fb-4f17-90ad-a6d177c9b528 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117300 Jun 22 10:28:29.393467 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 504/988] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jun 22 10:28:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:30.849964 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b23bbdab-5bbe-4d5c-aa52-70249bf5e1e3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:30.857014 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b23bbdab-5bbe-4d5c-aa52-70249bf5e1e3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:30.857014 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=15 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:30.857937 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b23bbdab-5bbe-4d5c-aa52-70249bf5e1e3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:30.858509 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b23bbdab-5bbe-4d5c-aa52-70249bf5e1e3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:30.859176 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b23bbdab-5bbe-4d5c-aa52-70249bf5e1e3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:30.859635 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b23bbdab-5bbe-4d5c-aa52-70249bf5e1e3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:30.863161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:30.893656 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b23bbdab-5bbe-4d5c-aa52-70249bf5e1e3 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments/9722e48f-87fc-44dd-8f15-6fc026e524ed" status: 200 len: 194 microversion: 2.1 time: 0.047911 Jun 22 10:28:30.895628 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 485/989] 10.222.0.46 () {58 vars in 1412 bytes} [Wed Jun 22 10:28:30 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments/9722e48f-87fc-44dd-8f15-6fc026e524ed => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:30.905173 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9e351793-5672-41a9-8e86-d13fcfbe5f25 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:30.905714 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9e351793-5672-41a9-8e86-d13fcfbe5f25 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:30.912186 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9e351793-5672-41a9-8e86-d13fcfbe5f25 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:30.912646 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9e351793-5672-41a9-8e86-d13fcfbe5f25 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:30.913568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9e351793-5672-41a9-8e86-d13fcfbe5f25 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:30.914096 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9e351793-5672-41a9-8e86-d13fcfbe5f25 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:30.997591 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-9e351793-5672-41a9-8e86-d13fcfbe5f25 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lazy-loading 'services' on Instance uuid b9708aae-3c6d-424c-b082-97d46349a712 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:28:31.277860 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9e351793-5672-41a9-8e86-d13fcfbe5f25 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments/9722e48f-87fc-44dd-8f15-6fc026e524ed" status: 202 len: 0 microversion: 2.1 time: 0.377425 Jun 22 10:28:31.278481 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 505/990] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jun 22 10:28:30 2022] DELETE /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments/9722e48f-87fc-44dd-8f15-6fc026e524ed => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:28:31.791474 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-818848858", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50c0d4d4-6a37-4a0f-93d4-ead4b389795a"}], "security_groups": [{"name": "tempest-securitygroup--1334291471"}], "key_name": "tempest-keypair-1683073988", "user_data": "}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:31.897288 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.network.neutron [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] validate_networks() for [('50c0d4d4-6a37-4a0f-93d4-ead4b389795a', None, None, None, None, None)] {{(pid=118326) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:28:32.152016 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:28:32.152620 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Wed Jun 22 10:28:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:28:32.276579 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Flavor limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:28:32.277034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Image limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:28:32.277500 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Flavor pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:28:32.277902 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Image pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:28:32.278305 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:28:32.287498 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:32.287938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:32.288725 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:32.289183 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:32.306893 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for project 347c4ccbcb464091b8254475babf2874. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:28:32.311163 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for user 082ece6ea4244242a6ba99152572c80f and project 347c4ccbcb464091b8254475babf2874. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:28:32.324341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Going to run 1 instances... {{(pid=118326) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:28:32.326632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118326) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:28:32.441802 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a4ed263f-760f-40ef-8af9-f7f576f4243e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:32.442810 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a4ed263f-760f-40ef-8af9-f7f576f4243e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:32.449090 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4ed263f-760f-40ef-8af9-f7f576f4243e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:32.449551 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4ed263f-760f-40ef-8af9-f7f576f4243e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:32.450327 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4ed263f-760f-40ef-8af9-f7f576f4243e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:32.450771 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a4ed263f-760f-40ef-8af9-f7f576f4243e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:32.479913 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a4ed263f-760f-40ef-8af9-f7f576f4243e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043409 Jun 22 10:28:32.480465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 506/991] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:28:32 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:28:32.503209 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-38bf58c2-e947-4e5f-b8ff-b2f72fc0766b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.716009 Jun 22 10:28:32.508787 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 486/992] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:28:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 10:28:32.514751 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-56a21c2c-0ef9-48d3-8259-f0f0ac1dc449 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:32.515857 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-56a21c2c-0ef9-48d3-8259-f0f0ac1dc449 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:32.596376 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-56a21c2c-0ef9-48d3-8259-f0f0ac1dc449 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:32.596736 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1949cabb-8c40-46a0-8c97-21a91992e86a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:32.597758 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1949cabb-8c40-46a0-8c97-21a91992e86a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:32.604640 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1949cabb-8c40-46a0-8c97-21a91992e86a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:32.606695 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-56a21c2c-0ef9-48d3-8259-f0f0ac1dc449 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1241 microversion: 2.1 time: 0.096651 Jun 22 10:28:32.607529 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 507/993] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:32 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:32.612654 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1949cabb-8c40-46a0-8c97-21a91992e86a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:32.613521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1949cabb-8c40-46a0-8c97-21a91992e86a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:32.613969 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1949cabb-8c40-46a0-8c97-21a91992e86a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:32.644058 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1949cabb-8c40-46a0-8c97-21a91992e86a tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051938 Jun 22 10:28:32.644629 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 487/994] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:28:32 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 10:28:32.704044 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b60750d8-009f-4291-9076-c2b8ec6cf24c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:32.706478 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b60750d8-009f-4291-9076-c2b8ec6cf24c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:32.710724 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b60750d8-009f-4291-9076-c2b8ec6cf24c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:32.711178 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b60750d8-009f-4291-9076-c2b8ec6cf24c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:32.711945 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b60750d8-009f-4291-9076-c2b8ec6cf24c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:32.712388 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b60750d8-009f-4291-9076-c2b8ec6cf24c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:32.739530 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b60750d8-009f-4291-9076-c2b8ec6cf24c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Going to try to terminate instance {{(pid=118327) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:28:33.106268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b60750d8-009f-4291-9076-c2b8ec6cf24c tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 204 len: 0 microversion: 2.1 time: 0.405772 Jun 22 10:28:33.107926 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 508/995] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:28:32 2022] DELETE /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:28:33.117042 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-38eb97c1-e6c3-47de-a428-85a6325241f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:33.117718 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-38eb97c1-e6c3-47de-a428-85a6325241f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:33.125644 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38eb97c1-e6c3-47de-a428-85a6325241f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:33.126113 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38eb97c1-e6c3-47de-a428-85a6325241f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:33.126895 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38eb97c1-e6c3-47de-a428-85a6325241f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:33.127654 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-38eb97c1-e6c3-47de-a428-85a6325241f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:33.264400 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-38eb97c1-e6c3-47de-a428-85a6325241f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:33.272620 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-38eb97c1-e6c3-47de-a428-85a6325241f7 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1672 microversion: 2.1 time: 0.160580 Jun 22 10:28:33.273224 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 488/996] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:33 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:33.626641 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9871eca7-086d-4548-9c81-42bbf4050b4d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:33.627313 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9871eca7-086d-4548-9c81-42bbf4050b4d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:33.633865 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9871eca7-086d-4548-9c81-42bbf4050b4d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:33.642308 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9871eca7-086d-4548-9c81-42bbf4050b4d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:33.642308 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9871eca7-086d-4548-9c81-42bbf4050b4d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:33.642308 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9871eca7-086d-4548-9c81-42bbf4050b4d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:33.699617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9871eca7-086d-4548-9c81-42bbf4050b4d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:33.707674 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9871eca7-086d-4548-9c81-42bbf4050b4d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1245 microversion: 2.1 time: 0.085886 Jun 22 10:28:33.708241 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 509/997] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:33 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:34.291028 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bed0c796-31cb-44eb-9033-fc95d1fb4160 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:34.291636 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bed0c796-31cb-44eb-9033-fc95d1fb4160 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:34.298817 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bed0c796-31cb-44eb-9033-fc95d1fb4160 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:34.299265 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bed0c796-31cb-44eb-9033-fc95d1fb4160 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:34.300033 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bed0c796-31cb-44eb-9033-fc95d1fb4160 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:34.300471 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bed0c796-31cb-44eb-9033-fc95d1fb4160 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:34.431757 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bed0c796-31cb-44eb-9033-fc95d1fb4160 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:34.439313 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bed0c796-31cb-44eb-9033-fc95d1fb4160 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1672 microversion: 2.1 time: 0.152191 Jun 22 10:28:34.439870 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 489/998] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:34 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:34.724453 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a8e8353e-5497-47db-80fb-1aa0cb2824c9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:34.725235 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a8e8353e-5497-47db-80fb-1aa0cb2824c9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:34.731766 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a8e8353e-5497-47db-80fb-1aa0cb2824c9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:34.732217 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a8e8353e-5497-47db-80fb-1aa0cb2824c9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:34.733038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a8e8353e-5497-47db-80fb-1aa0cb2824c9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:34.733474 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a8e8353e-5497-47db-80fb-1aa0cb2824c9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:34.737499 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:34.794212 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a8e8353e-5497-47db-80fb-1aa0cb2824c9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:34.801594 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a8e8353e-5497-47db-80fb-1aa0cb2824c9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1245 microversion: 2.1 time: 0.081756 Jun 22 10:28:34.802156 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 510/999] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:34 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:35.457100 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-80c8a9a9-4b04-4345-b1bc-4606d2d1fe6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:35.457709 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-80c8a9a9-4b04-4345-b1bc-4606d2d1fe6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:35.464231 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80c8a9a9-4b04-4345-b1bc-4606d2d1fe6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:35.464686 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80c8a9a9-4b04-4345-b1bc-4606d2d1fe6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:35.465488 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80c8a9a9-4b04-4345-b1bc-4606d2d1fe6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:35.465927 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80c8a9a9-4b04-4345-b1bc-4606d2d1fe6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:35.592006 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-80c8a9a9-4b04-4345-b1bc-4606d2d1fe6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:35.600136 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-80c8a9a9-4b04-4345-b1bc-4606d2d1fe6d tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1672 microversion: 2.1 time: 0.147514 Jun 22 10:28:35.600693 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 490/1000] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:35 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:35.819098 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5a1f5627-c594-4694-8619-d019c05637b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:35.819736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5a1f5627-c594-4694-8619-d019c05637b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:35.826623 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5a1f5627-c594-4694-8619-d019c05637b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:35.827075 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5a1f5627-c594-4694-8619-d019c05637b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:35.827843 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5a1f5627-c594-4694-8619-d019c05637b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:35.828282 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5a1f5627-c594-4694-8619-d019c05637b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:35.894528 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5a1f5627-c594-4694-8619-d019c05637b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:35.902005 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5a1f5627-c594-4694-8619-d019c05637b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1245 microversion: 2.1 time: 0.087183 Jun 22 10:28:35.902569 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 511/1001] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:35 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:36.117141 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:28:36.117493 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Wed Jun 22 10:28:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:28:36.617376 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e3e7a3a6-b5f3-426a-a0aa-dff2aca745bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:36.617992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e3e7a3a6-b5f3-426a-a0aa-dff2aca745bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:36.624539 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e3e7a3a6-b5f3-426a-a0aa-dff2aca745bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.625032 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e3e7a3a6-b5f3-426a-a0aa-dff2aca745bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.625831 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e3e7a3a6-b5f3-426a-a0aa-dff2aca745bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.626270 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e3e7a3a6-b5f3-426a-a0aa-dff2aca745bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.753549 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e3e7a3a6-b5f3-426a-a0aa-dff2aca745bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:36.761045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e3e7a3a6-b5f3-426a-a0aa-dff2aca745bb tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1672 microversion: 2.1 time: 0.147583 Jun 22 10:28:36.761679 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 491/1002] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:36 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:36.919492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f487b278-8f41-4166-8359-167ac9595234 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:36.920059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f487b278-8f41-4166-8359-167ac9595234 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:36.927397 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f487b278-8f41-4166-8359-167ac9595234 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.927851 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f487b278-8f41-4166-8359-167ac9595234 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.928615 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f487b278-8f41-4166-8359-167ac9595234 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.929078 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f487b278-8f41-4166-8359-167ac9595234 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.989503 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f487b278-8f41-4166-8359-167ac9595234 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:36.997707 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f487b278-8f41-4166-8359-167ac9595234 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1245 microversion: 2.1 time: 0.082245 Jun 22 10:28:36.998276 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 512/1003] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:36 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:37.778762 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3db5b5dc-55ed-4c3a-b586-1c3b6b0968ad tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:37.779405 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3db5b5dc-55ed-4c3a-b586-1c3b6b0968ad tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:37.786578 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3db5b5dc-55ed-4c3a-b586-1c3b6b0968ad tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:37.792684 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3db5b5dc-55ed-4c3a-b586-1c3b6b0968ad tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:37.792684 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3db5b5dc-55ed-4c3a-b586-1c3b6b0968ad tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:37.792684 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3db5b5dc-55ed-4c3a-b586-1c3b6b0968ad tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:37.919155 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3db5b5dc-55ed-4c3a-b586-1c3b6b0968ad tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:37.927335 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3db5b5dc-55ed-4c3a-b586-1c3b6b0968ad tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1672 microversion: 2.1 time: 0.152540 Jun 22 10:28:37.927954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 492/1004] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:37 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:38.015275 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a6a3c7b6-bf90-463c-96e6-40b0e1c687fe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:38.015876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a6a3c7b6-bf90-463c-96e6-40b0e1c687fe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:38.022884 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a6a3c7b6-bf90-463c-96e6-40b0e1c687fe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:38.023334 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a6a3c7b6-bf90-463c-96e6-40b0e1c687fe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:38.024092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a6a3c7b6-bf90-463c-96e6-40b0e1c687fe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:38.024520 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a6a3c7b6-bf90-463c-96e6-40b0e1c687fe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:38.086726 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a6a3c7b6-bf90-463c-96e6-40b0e1c687fe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:38.094278 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a6a3c7b6-bf90-463c-96e6-40b0e1c687fe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1245 microversion: 2.1 time: 0.083060 Jun 22 10:28:38.094848 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 513/1005] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:38 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:38.946189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-aac7e9b2-c62e-495e-9eda-666b1b54e001 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:38.955120 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-aac7e9b2-c62e-495e-9eda-666b1b54e001 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:38.955120 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aac7e9b2-c62e-495e-9eda-666b1b54e001 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:38.955120 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aac7e9b2-c62e-495e-9eda-666b1b54e001 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:38.955120 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aac7e9b2-c62e-495e-9eda-666b1b54e001 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:38.955546 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-aac7e9b2-c62e-495e-9eda-666b1b54e001 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:39.102622 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-aac7e9b2-c62e-495e-9eda-666b1b54e001 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:39.111875 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f6c04943-e008-49b7-90af-a676a7c9ee4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:39.112467 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-aac7e9b2-c62e-495e-9eda-666b1b54e001 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1672 microversion: 2.1 time: 0.171165 Jun 22 10:28:39.112870 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f6c04943-e008-49b7-90af-a676a7c9ee4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:39.119484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f6c04943-e008-49b7-90af-a676a7c9ee4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:39.120045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f6c04943-e008-49b7-90af-a676a7c9ee4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:39.121128 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f6c04943-e008-49b7-90af-a676a7c9ee4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:39.121491 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 493/1006] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:38 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:39.121638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f6c04943-e008-49b7-90af-a676a7c9ee4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:39.250032 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f6c04943-e008-49b7-90af-a676a7c9ee4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:39.258709 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f6c04943-e008-49b7-90af-a676a7c9ee4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1293 microversion: 2.1 time: 0.151601 Jun 22 10:28:39.259293 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 514/1007] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:39 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1293 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:40.096942 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-04faddda-bc74-4bbd-8a9e-db4ed6316d98 req-f18ede3b-55b8-49e0-9cbb-c7aa879013bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9708aae-3c6d-424c-b082-97d46349a712", "name": "network-vif-deleted", "tag": "f6899223-0cb6-4972-ae2f-846f84786e67"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:40.111779 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-04faddda-bc74-4bbd-8a9e-db4ed6316d98 req-f18ede3b-55b8-49e0-9cbb-c7aa879013bf service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:40.116516 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-04faddda-bc74-4bbd-8a9e-db4ed6316d98 req-f18ede3b-55b8-49e0-9cbb-c7aa879013bf service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:40.129756 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2684d0c1-b920-46cb-9704-3a9e39418f0e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:40.140431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2684d0c1-b920-46cb-9704-3a9e39418f0e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:40.142569 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2684d0c1-b920-46cb-9704-3a9e39418f0e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:40.143311 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2684d0c1-b920-46cb-9704-3a9e39418f0e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:40.144098 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-04faddda-bc74-4bbd-8a9e-db4ed6316d98 req-f18ede3b-55b8-49e0-9cbb-c7aa879013bf service nova] Creating event network-vif-deleted:f6899223-0cb6-4972-ae2f-846f84786e67 for instance b9708aae-3c6d-424c-b082-97d46349a712 on hv-cinder-84327 Jun 22 10:28:40.145040 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2684d0c1-b920-46cb-9704-3a9e39418f0e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:40.145655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2684d0c1-b920-46cb-9704-3a9e39418f0e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:40.165665 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-04faddda-bc74-4bbd-8a9e-db4ed6316d98 req-f18ede3b-55b8-49e0-9cbb-c7aa879013bf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072489 Jun 22 10:28:40.171001 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 494/1008] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:40.276561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-82c51780-7e66-410c-9af1-8d284b26ee35 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:40.277558 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-82c51780-7e66-410c-9af1-8d284b26ee35 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:40.291146 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82c51780-7e66-410c-9af1-8d284b26ee35 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:40.291146 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82c51780-7e66-410c-9af1-8d284b26ee35 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:40.291146 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82c51780-7e66-410c-9af1-8d284b26ee35 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:40.291146 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-82c51780-7e66-410c-9af1-8d284b26ee35 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:40.600636 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-82c51780-7e66-410c-9af1-8d284b26ee35 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:40.603195 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2684d0c1-b920-46cb-9704-3a9e39418f0e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:40.608839 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-82c51780-7e66-410c-9af1-8d284b26ee35 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1299 microversion: 2.1 time: 0.336869 Jun 22 10:28:40.610321 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 495/1009] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:40 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1299 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:40.615428 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2684d0c1-b920-46cb-9704-3a9e39418f0e tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1604 microversion: 2.1 time: 0.490227 Jun 22 10:28:40.616280 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 515/1010] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:40 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1604 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:41.626816 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1eef118d-204f-47c2-95e0-ea3fc8f97e34 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:41.631071 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1eef118d-204f-47c2-95e0-ea3fc8f97e34 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:41.636509 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0d6efda3-dd65-43f1-a327-a862a1159649 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:41.637879 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0d6efda3-dd65-43f1-a327-a862a1159649 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:41.639164 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1eef118d-204f-47c2-95e0-ea3fc8f97e34 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:41.639909 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1eef118d-204f-47c2-95e0-ea3fc8f97e34 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:41.640884 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1eef118d-204f-47c2-95e0-ea3fc8f97e34 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:41.642035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1eef118d-204f-47c2-95e0-ea3fc8f97e34 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:41.648257 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0d6efda3-dd65-43f1-a327-a862a1159649 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:41.649324 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0d6efda3-dd65-43f1-a327-a862a1159649 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:41.650127 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0d6efda3-dd65-43f1-a327-a862a1159649 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:41.650572 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0d6efda3-dd65-43f1-a327-a862a1159649 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:41.714763 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0d6efda3-dd65-43f1-a327-a862a1159649 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:41.715317 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0d6efda3-dd65-43f1-a327-a862a1159649 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:41.715891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-0d6efda3-dd65-43f1-a327-a862a1159649 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lazy-loading 'fault' on Instance uuid b9708aae-3c6d-424c-b082-97d46349a712 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:28:41.780461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0d6efda3-dd65-43f1-a327-a862a1159649 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16265c4e556943369aa0cb3e961795bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43383a4476d847f797dfb43fbfc66e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:41.797403 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0d6efda3-dd65-43f1-a327-a862a1159649 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 200 len: 1327 microversion: 2.1 time: 0.165334 Jun 22 10:28:41.798805 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 516/1011] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:41 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 1327 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:41.893715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1eef118d-204f-47c2-95e0-ea3fc8f97e34 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:41.901462 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1eef118d-204f-47c2-95e0-ea3fc8f97e34 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1367 microversion: 2.1 time: 0.278924 Jun 22 10:28:41.902039 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 496/1012] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:41 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:42.028426 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-d5943fef-e385-42b7-aa0e-78f1916068cd req-8c6fe043-9533-4361-9f2d-566b68b445a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11", "tag": "64e04080-4795-49e9-b33a-4db1c06fc4c5"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:42.037473 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-d5943fef-e385-42b7-aa0e-78f1916068cd req-8c6fe043-9533-4361-9f2d-566b68b445a3 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:42.043932 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-d5943fef-e385-42b7-aa0e-78f1916068cd req-8c6fe043-9533-4361-9f2d-566b68b445a3 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:42.050797 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-d5943fef-e385-42b7-aa0e-78f1916068cd req-8c6fe043-9533-4361-9f2d-566b68b445a3 service nova] Creating event network-changed:64e04080-4795-49e9-b33a-4db1c06fc4c5 for instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 on hv-cinder-84327 Jun 22 10:28:42.059536 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-d5943fef-e385-42b7-aa0e-78f1916068cd req-8c6fe043-9533-4361-9f2d-566b68b445a3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034757 Jun 22 10:28:42.060152 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 517/1013] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:42.814384 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-50252e89-952b-495f-a3a8-5e4e1e1f6c54 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:42.814996 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-50252e89-952b-495f-a3a8-5e4e1e1f6c54 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:42.816973 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:42.820058 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=6 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:42.823241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-50252e89-952b-495f-a3a8-5e4e1e1f6c54 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:42.823698 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-50252e89-952b-495f-a3a8-5e4e1e1f6c54 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:42.824469 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-50252e89-952b-495f-a3a8-5e4e1e1f6c54 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:42.824941 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-50252e89-952b-495f-a3a8-5e4e1e1f6c54 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:42.838654 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-50252e89-952b-495f-a3a8-5e4e1e1f6c54 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] HTTP exception thrown: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-50252e89-952b-495f-a3a8-5e4e1e1f6c54 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Request method failure captured: Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 HTTP/1.1 Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisux58zGJ-1HFrwqomJB_HegERleKRTSv7ZcWOFhumgQHxnc2eyKDw_JRv9xfelSW-7u6wLOYgR_uqYuHTkuCJzXSaxZr62rYVQ30cZfePF-HAyfuekBsJZxq1ms36woZ-Wiw3LS27oLYYL_ZFNg0FVyvchVxB8JnXBZ23QhWKcl2ZsI Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 43383a4476d847f797dfb43fbfc66e42 Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:28:42.840287 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:28:42.841971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43383a4476d847f797dfb43fbfc66e42", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:28:42.841971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:42.841971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 43383a4476d847f797dfb43fbfc66e42 Jun 22 10:28:42.841971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:42.841971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeTestJSON-1325718796-project Jun 22 10:28:42.841971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:28:42.841971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:28:42.841971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 16265c4e556943369aa0cb3e961795bb Jun 22 10:28:42.841971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeTestJSON-1325718796-project Jun 22 10:28:42.841971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:28:42.841971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:42.841971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': 'b9708aae-3c6d-424c-b082-97d46349a712'} Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:42.842908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:42.845054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:42.846354 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-50252e89-952b-495f-a3a8-5e4e1e1f6c54 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Returning 404 to user: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:42.846354 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-50252e89-952b-495f-a3a8-5e4e1e1f6c54 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 404 len: 111 microversion: 2.1 time: 0.031245 Jun 22 10:28:42.846354 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 497/1014] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:42 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:42.848897 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=6 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:42.853691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f20e347f-dfb4-4e75-8e84-3eea41a2e918 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '.version_select at 0x7f021fd6b9d0>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:42.923109 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-26ba7a11-1656-4ee5-90f9-a0e2811f18f2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:42.923109 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-26ba7a11-1656-4ee5-90f9-a0e2811f18f2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:42.926269 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-26ba7a11-1656-4ee5-90f9-a0e2811f18f2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:42.926715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-26ba7a11-1656-4ee5-90f9-a0e2811f18f2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:42.927479 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-26ba7a11-1656-4ee5-90f9-a0e2811f18f2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:42.927916 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-26ba7a11-1656-4ee5-90f9-a0e2811f18f2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:42.964804 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f20e347f-dfb4-4e75-8e84-3eea41a2e918 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-767709485" status: 202 len: 0 microversion: 2.1 time: 0.116770 Jun 22 10:28:42.965703 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 518/1015] 10.222.0.46 () {58 vars in 1217 bytes} [Wed Jun 22 10:28:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-767709485 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:28:43.065481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-26ba7a11-1656-4ee5-90f9-a0e2811f18f2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:43.073116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-26ba7a11-1656-4ee5-90f9-a0e2811f18f2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1367 microversion: 2.1 time: 0.158062 Jun 22 10:28:43.073777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 498/1016] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:42 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:44.090708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f8a421ed-faf1-409f-9cec-97c6cfefb3cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:44.091435 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f8a421ed-faf1-409f-9cec-97c6cfefb3cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:44.100187 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f8a421ed-faf1-409f-9cec-97c6cfefb3cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:44.100652 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f8a421ed-faf1-409f-9cec-97c6cfefb3cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:44.101456 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f8a421ed-faf1-409f-9cec-97c6cfefb3cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:44.101894 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f8a421ed-faf1-409f-9cec-97c6cfefb3cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:44.234999 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f8a421ed-faf1-409f-9cec-97c6cfefb3cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:44.242564 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f8a421ed-faf1-409f-9cec-97c6cfefb3cf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1367 microversion: 2.1 time: 0.155887 Jun 22 10:28:44.243123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 519/1017] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:44 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:45.259326 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-af91b8e1-9206-400c-9191-8adc9612bfaf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:45.259936 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-af91b8e1-9206-400c-9191-8adc9612bfaf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:45.266576 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-af91b8e1-9206-400c-9191-8adc9612bfaf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:45.267025 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-af91b8e1-9206-400c-9191-8adc9612bfaf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:45.267858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-af91b8e1-9206-400c-9191-8adc9612bfaf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:45.268291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-af91b8e1-9206-400c-9191-8adc9612bfaf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:45.404511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-af91b8e1-9206-400c-9191-8adc9612bfaf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:45.413134 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-af91b8e1-9206-400c-9191-8adc9612bfaf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1367 microversion: 2.1 time: 0.157651 Jun 22 10:28:45.413699 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 499/1018] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:45 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:45.987767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-711104049", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-861565459", "security_groups": [{"name": "tempest-secgroup-smoke-1809832332"}], "block_device_mapping_v2": [{"uuid": "46041ebc-1aab-4ce8-b577-d84baee68ef1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d0645bff-6cba-4d07-864e-88eb84ff97aa"}]}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:46.097625 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.network.neutron [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] validate_networks() for [('d0645bff-6cba-4d07-864e-88eb84ff97aa', None, None, None, None, None)] {{(pid=118327) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:28:46.430696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-63fa9ff3-6bbf-4f01-b381-b57e33a562fd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:46.431307 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-63fa9ff3-6bbf-4f01-b381-b57e33a562fd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:46.438178 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-63fa9ff3-6bbf-4f01-b381-b57e33a562fd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:46.438626 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-63fa9ff3-6bbf-4f01-b381-b57e33a562fd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:46.439495 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-63fa9ff3-6bbf-4f01-b381-b57e33a562fd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:46.440378 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-63fa9ff3-6bbf-4f01-b381-b57e33a562fd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:46.481097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Flavor limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:28:46.481526 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Image limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:28:46.482003 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Flavor pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:28:46.482413 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Image pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:28:46.482825 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:28:46.491767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:46.492223 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:46.493072 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:46.493513 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:46.510290 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Getting quotas for project abd71b49f6d9403b8cea1fd9e7680ffb. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:28:46.514322 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Getting quotas for user 401fdd54d8a143a892fd2d2407a78bc5 and project abd71b49f6d9403b8cea1fd9e7680ffb. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:28:46.573395 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Going to run 1 instances... {{(pid=118327) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:28:46.575534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46041ebc-1aab-4ce8-b577-d84baee68ef1',volume_size=None,volume_type=None)] {{(pid=118327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:28:46.588034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-63fa9ff3-6bbf-4f01-b381-b57e33a562fd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:46.596882 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-63fa9ff3-6bbf-4f01-b381-b57e33a562fd tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1367 microversion: 2.1 time: 0.170107 Jun 22 10:28:46.597610 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 500/1019] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:46 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:46.603929 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c7cb521e-3646-4189-90fb-962995131943 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:46.604425 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c7cb521e-3646-4189-90fb-962995131943 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:46.610297 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c7cb521e-3646-4189-90fb-962995131943 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:46.610743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c7cb521e-3646-4189-90fb-962995131943 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:46.611509 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c7cb521e-3646-4189-90fb-962995131943 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:46.611944 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c7cb521e-3646-4189-90fb-962995131943 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:46.625166 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-c7cb521e-3646-4189-90fb-962995131943 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] HTTP exception thrown: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c7cb521e-3646-4189-90fb-962995131943 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Request method failure captured: Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: DELETE /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 HTTP/1.1 Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisux58zGJ-1HFrwqomJB_HegERleKRTSv7ZcWOFhumgQHxnc2eyKDw_JRv9xfelSW-7u6wLOYgR_uqYuHTkuCJzXSaxZr62rYVQ30cZfePF-HAyfuekBsJZxq1ms36woZ-Wiw3LS27oLYYL_ZFNg0FVyvchVxB8JnXBZ23QhWKcl2ZsI Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 43383a4476d847f797dfb43fbfc66e42 Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:28:46.626738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:28:46.628310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43383a4476d847f797dfb43fbfc66e42", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:28:46.628310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:46.628310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 43383a4476d847f797dfb43fbfc66e42 Jun 22 10:28:46.628310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:46.628310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeTestJSON-1325718796-project Jun 22 10:28:46.628310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:28:46.628310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:28:46.628310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 16265c4e556943369aa0cb3e961795bb Jun 22 10:28:46.628310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeTestJSON-1325718796-project Jun 22 10:28:46.628310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:28:46.628310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:46.628310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': 'b9708aae-3c6d-424c-b082-97d46349a712'} Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:46.631511 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:46.633214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:46.634667 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c7cb521e-3646-4189-90fb-962995131943 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Returning 404 to user: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:46.634667 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c7cb521e-3646-4189-90fb-962995131943 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 404 len: 111 microversion: 2.1 time: 0.029432 Jun 22 10:28:46.634667 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 501/1020] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:28:46 2022] DELETE /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:46.637733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5c43c442-6fdf-4d97-86fa-f0d7bd462930 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:46.638288 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5c43c442-6fdf-4d97-86fa-f0d7bd462930 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: b9708aae-3c6d-424c-b082-97d46349a712] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:46.644892 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5c43c442-6fdf-4d97-86fa-f0d7bd462930 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:46.645362 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5c43c442-6fdf-4d97-86fa-f0d7bd462930 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:46.646125 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5c43c442-6fdf-4d97-86fa-f0d7bd462930 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:46.646554 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5c43c442-6fdf-4d97-86fa-f0d7bd462930 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:46.660835 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-5c43c442-6fdf-4d97-86fa-f0d7bd462930 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] HTTP exception thrown: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5c43c442-6fdf-4d97-86fa-f0d7bd462930 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Request method failure captured: Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 HTTP/1.1 Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisux58zGJ-1HFrwqomJB_HegERleKRTSv7ZcWOFhumgQHxnc2eyKDw_JRv9xfelSW-7u6wLOYgR_uqYuHTkuCJzXSaxZr62rYVQ30cZfePF-HAyfuekBsJZxq1ms36woZ-Wiw3LS27oLYYL_ZFNg0FVyvchVxB8JnXBZ23QhWKcl2ZsI Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 43383a4476d847f797dfb43fbfc66e42 Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:28:46.662381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:28:46.663957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43383a4476d847f797dfb43fbfc66e42", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:28:46.663957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:46.663957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 43383a4476d847f797dfb43fbfc66e42 Jun 22 10:28:46.663957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:46.663957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeTestJSON-1325718796-project Jun 22 10:28:46.663957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:28:46.663957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:28:46.663957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 16265c4e556943369aa0cb3e961795bb Jun 22 10:28:46.663957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeTestJSON-1325718796-project Jun 22 10:28:46.663957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:28:46.663957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:46.663957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': 'b9708aae-3c6d-424c-b082-97d46349a712'} Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:46.664759 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. Jun 22 10:28:46.668332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:46.670212 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5c43c442-6fdf-4d97-86fa-f0d7bd462930 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Returning 404 to user: Instance b9708aae-3c6d-424c-b082-97d46349a712 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:46.670212 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5c43c442-6fdf-4d97-86fa-f0d7bd462930 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712" status: 404 len: 111 microversion: 2.1 time: 0.029703 Jun 22 10:28:46.670212 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 502/1021] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:46 2022] GET /compute/v2.1/servers/b9708aae-3c6d-424c-b082-97d46349a712 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:28:47.087325 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e6509ca5-ad52-444d-be3e-976ad69e6926 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.104099 Jun 22 10:28:47.088653 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 520/1022] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:28:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:28:47.098092 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-cd6025ae-d954-4d33-bbfa-76cfe740a014 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:47.098804 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-cd6025ae-d954-4d33-bbfa-76cfe740a014 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:47.151147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-cd6025ae-d954-4d33-bbfa-76cfe740a014 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:47.158588 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-cd6025ae-d954-4d33-bbfa-76cfe740a014 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1093 microversion: 2.1 time: 0.064275 Jun 22 10:28:47.159315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 503/1023] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:47 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:47.614458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-70744d7d-2b62-4229-b88d-d6178ecdcaa6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:47.615092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-70744d7d-2b62-4229-b88d-d6178ecdcaa6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:47.621527 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-70744d7d-2b62-4229-b88d-d6178ecdcaa6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:47.622008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-70744d7d-2b62-4229-b88d-d6178ecdcaa6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:47.622774 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-70744d7d-2b62-4229-b88d-d6178ecdcaa6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:47.623209 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-70744d7d-2b62-4229-b88d-d6178ecdcaa6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:47.755204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-70744d7d-2b62-4229-b88d-d6178ecdcaa6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:47.762738 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-70744d7d-2b62-4229-b88d-d6178ecdcaa6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1367 microversion: 2.1 time: 0.152852 Jun 22 10:28:47.763316 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 521/1024] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:47 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:48.000949 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-587ee9c2-a22c-48aa-9655-efcd67fd0d69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:48.006125 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-587ee9c2-a22c-48aa-9655-efcd67fd0d69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:48.007725 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-587ee9c2-a22c-48aa-9655-efcd67fd0d69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:48.008180 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-587ee9c2-a22c-48aa-9655-efcd67fd0d69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:48.008990 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-587ee9c2-a22c-48aa-9655-efcd67fd0d69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:48.009435 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-587ee9c2-a22c-48aa-9655-efcd67fd0d69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:48.023518 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-587ee9c2-a22c-48aa-9655-efcd67fd0d69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] HTTP exception thrown: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-587ee9c2-a22c-48aa-9655-efcd67fd0d69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Request method failure captured: Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: DELETE /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 HTTP/1.1 Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisux58zGJ-1HFrwqomJB_HegERleKRTSv7ZcWOFhumgQHxnc2eyKDw_JRv9xfelSW-7u6wLOYgR_uqYuHTkuCJzXSaxZr62rYVQ30cZfePF-HAyfuekBsJZxq1ms36woZ-Wiw3LS27oLYYL_ZFNg0FVyvchVxB8JnXBZ23QhWKcl2ZsI Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 43383a4476d847f797dfb43fbfc66e42 Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:28:48.025116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:28:48.026749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43383a4476d847f797dfb43fbfc66e42", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:28:48.026749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:48.026749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 43383a4476d847f797dfb43fbfc66e42 Jun 22 10:28:48.026749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:48.026749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeTestJSON-1325718796-project Jun 22 10:28:48.026749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:28:48.026749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:28:48.026749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 16265c4e556943369aa0cb3e961795bb Jun 22 10:28:48.026749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeTestJSON-1325718796-project Jun 22 10:28:48.026749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:28:48.026749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:28:48.026749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': 'a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5'} Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:48.027630 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:28:48.028938 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:48.030283 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-587ee9c2-a22c-48aa-9655-efcd67fd0d69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Returning 404 to user: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:48.030283 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-587ee9c2-a22c-48aa-9655-efcd67fd0d69 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 404 len: 111 microversion: 2.1 time: 0.029594 Jun 22 10:28:48.030283 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 504/1025] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:28:47 2022] DELETE /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:48.035973 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-324f8f92-3757-4ab0-a5a1-d6b3c0702281 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:48.036677 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-324f8f92-3757-4ab0-a5a1-d6b3c0702281 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] [instance: a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:48.043291 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-324f8f92-3757-4ab0-a5a1-d6b3c0702281 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:48.043741 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-324f8f92-3757-4ab0-a5a1-d6b3c0702281 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:48.044517 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-324f8f92-3757-4ab0-a5a1-d6b3c0702281 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:48.044991 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-324f8f92-3757-4ab0-a5a1-d6b3c0702281 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:48.058308 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-324f8f92-3757-4ab0-a5a1-d6b3c0702281 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] HTTP exception thrown: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-324f8f92-3757-4ab0-a5a1-d6b3c0702281 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Request method failure captured: Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 HTTP/1.1 Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisux58zGJ-1HFrwqomJB_HegERleKRTSv7ZcWOFhumgQHxnc2eyKDw_JRv9xfelSW-7u6wLOYgR_uqYuHTkuCJzXSaxZr62rYVQ30cZfePF-HAyfuekBsJZxq1ms36woZ-Wiw3LS27oLYYL_ZFNg0FVyvchVxB8JnXBZ23QhWKcl2ZsI Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 43383a4476d847f797dfb43fbfc66e42 Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:28:48.059956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:28:48.061568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_43383a4476d847f797dfb43fbfc66e42", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/43383a4476d847f797dfb43fbfc66e42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:28:48.061568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:48.061568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 43383a4476d847f797dfb43fbfc66e42 Jun 22 10:28:48.061568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1325718796 Jun 22 10:28:48.061568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-AttachVolumeTestJSON-1325718796-project Jun 22 10:28:48.061568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:28:48.061568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:28:48.061568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 16265c4e556943369aa0cb3e961795bb Jun 22 10:28:48.061568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-AttachVolumeTestJSON-1325718796-project Jun 22 10:28:48.061568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:28:48.061568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:28:48.061568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': 'a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5'} Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:48.062484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. Jun 22 10:28:48.064151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:48.065576 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-324f8f92-3757-4ab0-a5a1-d6b3c0702281 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] Returning 404 to user: Instance a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:48.065576 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-324f8f92-3757-4ab0-a5a1-d6b3c0702281 tempest-AttachVolumeTestJSON-1325718796 tempest-AttachVolumeTestJSON-1325718796-project] 10.222.0.46 "GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5" status: 404 len: 111 microversion: 2.1 time: 0.030150 Jun 22 10:28:48.065576 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 522/1026] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:48 2022] GET /compute/v2.1/servers/a0a1e41f-ef47-4f9b-9b07-2b53cb4bf5b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:48.175459 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5de46db3-9527-408d-a16b-12520cbbbcb0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:48.176362 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5de46db3-9527-408d-a16b-12520cbbbcb0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:48.182231 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5de46db3-9527-408d-a16b-12520cbbbcb0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:48.182754 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5de46db3-9527-408d-a16b-12520cbbbcb0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:48.187642 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5de46db3-9527-408d-a16b-12520cbbbcb0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:48.187642 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5de46db3-9527-408d-a16b-12520cbbbcb0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:48.255155 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5de46db3-9527-408d-a16b-12520cbbbcb0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:48.262582 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5de46db3-9527-408d-a16b-12520cbbbcb0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1143 microversion: 2.1 time: 0.090935 Jun 22 10:28:48.263274 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 505/1027] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:48 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1143 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:48.779676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-25ffada7-fc7a-4eb4-b945-e85bcbbf9aef tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:48.780233 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-25ffada7-fc7a-4eb4-b945-e85bcbbf9aef tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:48.787226 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-25ffada7-fc7a-4eb4-b945-e85bcbbf9aef tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:48.787607 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-25ffada7-fc7a-4eb4-b945-e85bcbbf9aef tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:48.788379 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-25ffada7-fc7a-4eb4-b945-e85bcbbf9aef tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:48.788834 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-25ffada7-fc7a-4eb4-b945-e85bcbbf9aef tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:48.992133 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-25ffada7-fc7a-4eb4-b945-e85bcbbf9aef tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:49.001431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-25ffada7-fc7a-4eb4-b945-e85bcbbf9aef tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1367 microversion: 2.1 time: 0.225398 Jun 22 10:28:49.002766 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 523/1028] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:48 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:49.279609 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3367e382-798e-4456-befb-29ccdcc68e85 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:49.281234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3367e382-798e-4456-befb-29ccdcc68e85 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:49.289053 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3367e382-798e-4456-befb-29ccdcc68e85 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:49.289863 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3367e382-798e-4456-befb-29ccdcc68e85 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:49.291235 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3367e382-798e-4456-befb-29ccdcc68e85 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:49.291876 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3367e382-798e-4456-befb-29ccdcc68e85 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:49.371607 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3367e382-798e-4456-befb-29ccdcc68e85 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:49.374018 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=100 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:49.382657 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3367e382-798e-4456-befb-29ccdcc68e85 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1199 microversion: 2.1 time: 0.106621 Jun 22 10:28:49.383519 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 506/1029] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:49 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1199 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:49.536786 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-e6e06e59-cdd2-45f6-a79e-1ed3169fd0b9 req-e64aae5b-f1af-4bce-9c25-7760b781be4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11", "name": "network-vif-plugged", "status": "completed", "tag": "64e04080-4795-49e9-b33a-4db1c06fc4c5"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:49.553263 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-e6e06e59-cdd2-45f6-a79e-1ed3169fd0b9 req-e64aae5b-f1af-4bce-9c25-7760b781be4c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:49.553715 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-e6e06e59-cdd2-45f6-a79e-1ed3169fd0b9 req-e64aae5b-f1af-4bce-9c25-7760b781be4c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:49.571813 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-e6e06e59-cdd2-45f6-a79e-1ed3169fd0b9 req-e64aae5b-f1af-4bce-9c25-7760b781be4c service nova] Creating event network-vif-plugged:64e04080-4795-49e9-b33a-4db1c06fc4c5 for instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 on hv-cinder-84327 Jun 22 10:28:49.578170 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-e6e06e59-cdd2-45f6-a79e-1ed3169fd0b9 req-e64aae5b-f1af-4bce-9c25-7760b781be4c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045261 Jun 22 10:28:49.579208 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 524/1030] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:50.021316 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-616c98f0-cb50-45be-9357-34600f7aceb2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:50.021316 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-616c98f0-cb50-45be-9357-34600f7aceb2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:50.028866 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-616c98f0-cb50-45be-9357-34600f7aceb2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:50.029330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-616c98f0-cb50-45be-9357-34600f7aceb2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:50.030118 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-616c98f0-cb50-45be-9357-34600f7aceb2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:50.030556 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-616c98f0-cb50-45be-9357-34600f7aceb2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:50.318624 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-616c98f0-cb50-45be-9357-34600f7aceb2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:50.326846 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-616c98f0-cb50-45be-9357-34600f7aceb2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1367 microversion: 2.1 time: 0.311091 Jun 22 10:28:50.327420 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 507/1031] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:50 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:50.402060 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d444cdba-3781-4526-8dc6-1471d6add1fe tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:50.402894 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d444cdba-3781-4526-8dc6-1471d6add1fe tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:50.410846 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d444cdba-3781-4526-8dc6-1471d6add1fe tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:50.411524 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d444cdba-3781-4526-8dc6-1471d6add1fe tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:50.412571 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d444cdba-3781-4526-8dc6-1471d6add1fe tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:50.413298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d444cdba-3781-4526-8dc6-1471d6add1fe tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:50.526923 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-d444cdba-3781-4526-8dc6-1471d6add1fe tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:50.537073 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d444cdba-3781-4526-8dc6-1471d6add1fe tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1209 microversion: 2.1 time: 0.138496 Jun 22 10:28:50.554464 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 525/1032] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:50 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1209 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:51.344433 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6efe1547-d376-4192-9c4e-3f8ce60720ed tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:51.344433 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6efe1547-d376-4192-9c4e-3f8ce60720ed tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:51.353311 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6efe1547-d376-4192-9c4e-3f8ce60720ed tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:51.353772 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6efe1547-d376-4192-9c4e-3f8ce60720ed tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:51.354555 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6efe1547-d376-4192-9c4e-3f8ce60720ed tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:51.354999 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6efe1547-d376-4192-9c4e-3f8ce60720ed tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:51.553845 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ef604b1e-d514-4b86-8076-622a7e647ab6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:51.555150 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ef604b1e-d514-4b86-8076-622a7e647ab6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:51.563446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef604b1e-d514-4b86-8076-622a7e647ab6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:51.564612 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef604b1e-d514-4b86-8076-622a7e647ab6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:51.565600 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef604b1e-d514-4b86-8076-622a7e647ab6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:51.566205 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ef604b1e-d514-4b86-8076-622a7e647ab6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:51.578574 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-6efe1547-d376-4192-9c4e-3f8ce60720ed tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:51.587096 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6efe1547-d376-4192-9c4e-3f8ce60720ed tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1367 microversion: 2.1 time: 0.247236 Jun 22 10:28:51.587915 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 508/1033] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:51 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:51.732804 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ef604b1e-d514-4b86-8076-622a7e647ab6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:51.759238 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ef604b1e-d514-4b86-8076-622a7e647ab6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.209343 Jun 22 10:28:51.772440 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 526/1034] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:51 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:52.153418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-f9dd7b56-8db5-4fb5-8f62-7ad7d7cd3fa4 req-6b4587cd-9927-4030-ba8e-c09b17838209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ebc75e-8531-4681-823f-01a293b4cdbb", "tag": "f2fcd12b-26c2-4da9-8312-532778fa247c"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:52.162626 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-f9dd7b56-8db5-4fb5-8f62-7ad7d7cd3fa4 req-6b4587cd-9927-4030-ba8e-c09b17838209 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:52.163461 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-f9dd7b56-8db5-4fb5-8f62-7ad7d7cd3fa4 req-6b4587cd-9927-4030-ba8e-c09b17838209 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:52.179562 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-f9dd7b56-8db5-4fb5-8f62-7ad7d7cd3fa4 req-6b4587cd-9927-4030-ba8e-c09b17838209 service nova] Creating event network-changed:f2fcd12b-26c2-4da9-8312-532778fa247c for instance 78ebc75e-8531-4681-823f-01a293b4cdbb on hv-cinder-84327 Jun 22 10:28:52.185238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-f9dd7b56-8db5-4fb5-8f62-7ad7d7cd3fa4 req-6b4587cd-9927-4030-ba8e-c09b17838209 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039090 Jun 22 10:28:52.186457 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 509/1035] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:52.603712 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bb58f911-836b-43b4-a713-d34ee53e6c28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:52.604650 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bb58f911-836b-43b4-a713-d34ee53e6c28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:52.612289 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bb58f911-836b-43b4-a713-d34ee53e6c28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:52.613123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bb58f911-836b-43b4-a713-d34ee53e6c28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:52.614155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bb58f911-836b-43b4-a713-d34ee53e6c28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:52.614669 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bb58f911-836b-43b4-a713-d34ee53e6c28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:52.779423 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-526079dc-438a-45a8-9952-4d2ea145c838 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:52.780122 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-526079dc-438a-45a8-9952-4d2ea145c838 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:52.787530 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-526079dc-438a-45a8-9952-4d2ea145c838 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:52.788426 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-526079dc-438a-45a8-9952-4d2ea145c838 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:52.789407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-526079dc-438a-45a8-9952-4d2ea145c838 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:52.789989 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-526079dc-438a-45a8-9952-4d2ea145c838 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:52.896041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bb58f911-836b-43b4-a713-d34ee53e6c28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:52.904738 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bb58f911-836b-43b4-a713-d34ee53e6c28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1557 microversion: 2.1 time: 0.304986 Jun 22 10:28:52.905606 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 527/1036] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:52 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1557 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:52.924113 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-414dbb76-f8f5-4e58-8470-65963ddc6548 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:52.924995 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-414dbb76-f8f5-4e58-8470-65963ddc6548 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:52.931750 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-414dbb76-f8f5-4e58-8470-65963ddc6548 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:52.932535 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-414dbb76-f8f5-4e58-8470-65963ddc6548 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:52.933565 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-414dbb76-f8f5-4e58-8470-65963ddc6548 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:52.935578 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-414dbb76-f8f5-4e58-8470-65963ddc6548 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:53.073292 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-526079dc-438a-45a8-9952-4d2ea145c838 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:53.083183 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-526079dc-438a-45a8-9952-4d2ea145c838 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.308738 Jun 22 10:28:53.084159 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-414dbb76-f8f5-4e58-8470-65963ddc6548 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164151 Jun 22 10:28:53.084159 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 528/1037] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jun 22 10:28:52 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:28:53.084374 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 510/1038] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:52 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:54.100587 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-660fdf69-a8cb-41e2-b1fe-645e9ca6c2ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:54.101423 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-660fdf69-a8cb-41e2-b1fe-645e9ca6c2ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:54.107457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-660fdf69-a8cb-41e2-b1fe-645e9ca6c2ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:54.107908 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-660fdf69-a8cb-41e2-b1fe-645e9ca6c2ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:54.108681 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-660fdf69-a8cb-41e2-b1fe-645e9ca6c2ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:54.109145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-660fdf69-a8cb-41e2-b1fe-645e9ca6c2ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:54.264362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-660fdf69-a8cb-41e2-b1fe-645e9ca6c2ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:54.273033 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-660fdf69-a8cb-41e2-b1fe-645e9ca6c2ec tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.177244 Jun 22 10:28:54.273928 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 529/1039] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:54 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:54.401681 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-ce489a1a-223d-48ae-b3dd-f0ced378c72d req-eb64e81d-7bb1-4e4d-b07d-5a6c36544286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11", "tag": "64e04080-4795-49e9-b33a-4db1c06fc4c5"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:54.411024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-ce489a1a-223d-48ae-b3dd-f0ced378c72d req-eb64e81d-7bb1-4e4d-b07d-5a6c36544286 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:54.411564 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-ce489a1a-223d-48ae-b3dd-f0ced378c72d req-eb64e81d-7bb1-4e4d-b07d-5a6c36544286 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:54.423155 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-ce489a1a-223d-48ae-b3dd-f0ced378c72d req-eb64e81d-7bb1-4e4d-b07d-5a6c36544286 service nova] Creating event network-changed:64e04080-4795-49e9-b33a-4db1c06fc4c5 for instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 on hv-cinder-84327 Jun 22 10:28:54.432219 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-ce489a1a-223d-48ae-b3dd-f0ced378c72d req-eb64e81d-7bb1-4e4d-b07d-5a6c36544286 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030593 Jun 22 10:28:54.432219 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 511/1040] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:28:55.291543 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a120ae7d-af6b-407e-94ff-8ccf1dbbedd3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:55.292278 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a120ae7d-af6b-407e-94ff-8ccf1dbbedd3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:55.299923 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a120ae7d-af6b-407e-94ff-8ccf1dbbedd3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:55.300453 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a120ae7d-af6b-407e-94ff-8ccf1dbbedd3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:55.301349 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a120ae7d-af6b-407e-94ff-8ccf1dbbedd3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:55.301877 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a120ae7d-af6b-407e-94ff-8ccf1dbbedd3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:55.320081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=100 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:55.442230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a120ae7d-af6b-407e-94ff-8ccf1dbbedd3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:55.451156 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a120ae7d-af6b-407e-94ff-8ccf1dbbedd3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.163665 Jun 22 10:28:55.451723 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 530/1041] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:55 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:55.705815 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-77ec4eae-11d1-4b30-9fbe-a8723ad788a2 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Action: 'create', calling method: .version_select at 0x7f021fb2e9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-546258223", "metadata": {"Type": "work"}}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-77ec4eae-11d1-4b30-9fbe-a8723ad788a2 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Request method failure captured: Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 121 Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu7nvExCPGvLdETSMXa7ihw3PW7539reFnLAQ65FWAWq2myYwXFQ2jNi7XhZBLWOWg9VnVDz6GAQgpIQkWIaSUlzVL4S326s6TjwCnHRqcm64ZPh0xfoXkSyO4wDcAqwEKxnOM5HVcrEOA3h_UpI0FB_9rz5s49t1ipkDBkgYvr3EoE Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: ccd78f6dc7614809ae7c3beeed092cdb Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:28:55.736837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ccd78f6dc7614809ae7c3beeed092cdb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: ccd78f6dc7614809ae7c3beeed092cdb Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-VolumesNegativeTest-1009950857-project Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: ed921b8887e44345ac543d4f97e74281 Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-VolumesNegativeTest-1009950857-project Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-546258223", "metadata": {"Type": "work"}}} Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: Jun 22 10:28:55.738920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-546258223', 'metadata': {'Type': 'work'}}}} Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise error Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi '#$%' Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:55.740627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 10:28:55.743360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 10:28:55.745735 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 10:28:55.745735 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.745735 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-77ec4eae-11d1-4b30-9fbe-a8723ad788a2 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:55.745735 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-77ec4eae-11d1-4b30-9fbe-a8723ad788a2 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.146264 Jun 22 10:28:55.745735 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 512/1042] 10.222.0.46 () {60 vars in 1155 bytes} [Wed Jun 22 10:28:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:28:55.749370 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e3adc209-4538-4b7e-b08f-7e40874ec7e7 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Action: 'create', calling method: .version_select at 0x7f021fc2bf70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-830605635", "metadata": {"Type": "work"}}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e3adc209-4538-4b7e-b08f-7e40874ec7e7 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Request method failure captured: Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 119 Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu7nvExCPGvLdETSMXa7ihw3PW7539reFnLAQ65FWAWq2myYwXFQ2jNi7XhZBLWOWg9VnVDz6GAQgpIQkWIaSUlzVL4S326s6TjwCnHRqcm64ZPh0xfoXkSyO4wDcAqwEKxnOM5HVcrEOA3h_UpI0FB_9rz5s49t1ipkDBkgYvr3EoE Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: ccd78f6dc7614809ae7c3beeed092cdb Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:28:55.754728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ccd78f6dc7614809ae7c3beeed092cdb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: ccd78f6dc7614809ae7c3beeed092cdb Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-VolumesNegativeTest-1009950857-project Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: ed921b8887e44345ac543d4f97e74281 Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-VolumesNegativeTest-1009950857-project Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-830605635", "metadata": {"Type": "work"}}} Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: Jun 22 10:28:55.757787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-830605635', 'metadata': {'Type': 'work'}}}} Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise error Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi '0' Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:55.759446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 10:28:55.762512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 10:28:55.764523 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 10:28:55.764523 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.764523 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e3adc209-4538-4b7e-b08f-7e40874ec7e7 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:55.764523 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e3adc209-4538-4b7e-b08f-7e40874ec7e7 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009192 Jun 22 10:28:55.764523 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 531/1043] 10.222.0.46 () {60 vars in 1155 bytes} [Wed Jun 22 10:28:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:28:55.766217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-511e2f2e-870a-44ca-a32b-e7186171c24f tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Action: 'create', calling method: .version_select at 0x7f021fd51670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2039264488", "metadata": {"Type": "work"}}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-511e2f2e-870a-44ca-a32b-e7186171c24f tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Request method failure captured: Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 119 Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu7nvExCPGvLdETSMXa7ihw3PW7539reFnLAQ65FWAWq2myYwXFQ2jNi7XhZBLWOWg9VnVDz6GAQgpIQkWIaSUlzVL4S326s6TjwCnHRqcm64ZPh0xfoXkSyO4wDcAqwEKxnOM5HVcrEOA3h_UpI0FB_9rz5s49t1ipkDBkgYvr3EoE Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: ccd78f6dc7614809ae7c3beeed092cdb Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:28:55.769091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ccd78f6dc7614809ae7c3beeed092cdb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: ccd78f6dc7614809ae7c3beeed092cdb Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-VolumesNegativeTest-1009950857-project Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: ed921b8887e44345ac543d4f97e74281 Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-VolumesNegativeTest-1009950857-project Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2039264488", "metadata": {"Type": "work"}}} Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: Jun 22 10:28:55.770599 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2039264488', 'metadata': {'Type': 'work'}}}} Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise error Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi '' Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:55.771696 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 10:28:55.773330 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 10:28:55.775355 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 10:28:55.775355 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.775355 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-511e2f2e-870a-44ca-a32b-e7186171c24f tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:55.775355 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-511e2f2e-870a-44ca-a32b-e7186171c24f tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008266 Jun 22 10:28:55.775355 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 513/1044] 10.222.0.46 () {60 vars in 1155 bytes} [Wed Jun 22 10:28:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 10:28:55.780094 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fb43882c-27e8-407f-b53f-a21320832f99 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Calling method '.version_select at 0x7f021fdaeca0>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:55.817033 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-fb43882c-27e8-407f-b53f-a21320832f99 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] HTTP exception thrown: Volume tempest-invalid-956561831 could not be found. Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fb43882c-27e8-407f-b53f-a21320832f99 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Request method failure captured: Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-956561831 HTTP/1.1 Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu7nvExCPGvLdETSMXa7ihw3PW7539reFnLAQ65FWAWq2myYwXFQ2jNi7XhZBLWOWg9VnVDz6GAQgpIQkWIaSUlzVL4S326s6TjwCnHRqcm64ZPh0xfoXkSyO4wDcAqwEKxnOM5HVcrEOA3h_UpI0FB_9rz5s49t1ipkDBkgYvr3EoE Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: ccd78f6dc7614809ae7c3beeed092cdb Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:28:55.819876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ccd78f6dc7614809ae7c3beeed092cdb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: ccd78f6dc7614809ae7c3beeed092cdb Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-VolumesNegativeTest-1009950857-project Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: ed921b8887e44345ac543d4f97e74281 Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-VolumesNegativeTest-1009950857-project Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Volume tempest-invalid-956561831 could not be found. Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': 'tempest-invalid-956561831'} Jun 22 10:28:55.822145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-956561831 could not be found. (HTTP 404) (Request-ID: req-2874db8a-c9ed-4cd7-b4d1-749c6fe177ec) Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.823059 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:28:55.824461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-956561831 could not be found. Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:55.827126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-956561831 could not be found. Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-956561831 could not be found. Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fb43882c-27e8-407f-b53f-a21320832f99 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Returning 404 to user: Volume tempest-invalid-956561831 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-fb43882c-27e8-407f-b53f-a21320832f99 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-956561831" status: 404 len: 98 microversion: 2.1 time: 0.045193 Jun 22 10:28:55.828622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 532/1045] 10.222.0.46 () {58 vars in 1214 bytes} [Wed Jun 22 10:28:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-956561831 => generated 98 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 22 10:28:55.835734 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8b42859e-173a-4032-9314-0ac87a3f0361 tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003863 Jun 22 10:28:55.836238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 514/1046] 10.222.0.46 () {58 vars in 1139 bytes} [Wed Jun 22 10:28:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 10:28:55.845850 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c4f1bdda-de6e-4713-8530-8007790b444f tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004169 Jun 22 10:28:55.846370 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 533/1047] 10.222.0.46 () {58 vars in 1136 bytes} [Wed Jun 22 10:28:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 10:28:55.854884 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d3d0d44b-4a77-4a26-84df-4dcd8bc4736f tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Calling method '.version_select at 0x7f021fa910d0>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:55.884315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-d3d0d44b-4a77-4a26-84df-4dcd8bc4736f tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] HTTP exception thrown: Volume 670a2d4b-fa11-4acd-8a27-94f9664efc13 could not be found. Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d3d0d44b-4a77-4a26-84df-4dcd8bc4736f tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Request method failure captured: Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: DELETE /compute/v2.1/os-volumes/670a2d4b-fa11-4acd-8a27-94f9664efc13 HTTP/1.1 Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu7nvExCPGvLdETSMXa7ihw3PW7539reFnLAQ65FWAWq2myYwXFQ2jNi7XhZBLWOWg9VnVDz6GAQgpIQkWIaSUlzVL4S326s6TjwCnHRqcm64ZPh0xfoXkSyO4wDcAqwEKxnOM5HVcrEOA3h_UpI0FB_9rz5s49t1ipkDBkgYvr3EoE Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: ccd78f6dc7614809ae7c3beeed092cdb Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:28:55.886315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ccd78f6dc7614809ae7c3beeed092cdb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: ccd78f6dc7614809ae7c3beeed092cdb Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-VolumesNegativeTest-1009950857-project Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: ed921b8887e44345ac543d4f97e74281 Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-VolumesNegativeTest-1009950857-project Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Volume 670a2d4b-fa11-4acd-8a27-94f9664efc13 could not be found. Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '670a2d4b-fa11-4acd-8a27-94f9664efc13'} Jun 22 10:28:55.894341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 670a2d4b-fa11-4acd-8a27-94f9664efc13 could not be found. (HTTP 404) (Request-ID: req-755c08a3-69a3-4232-ba7c-071d6f50f71b) Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.895262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:28:55.896632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 670a2d4b-fa11-4acd-8a27-94f9664efc13 could not be found. Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 10:28:55.898024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 670a2d4b-fa11-4acd-8a27-94f9664efc13 could not be found. Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 670a2d4b-fa11-4acd-8a27-94f9664efc13 could not be found. Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d3d0d44b-4a77-4a26-84df-4dcd8bc4736f tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Returning 404 to user: Volume 670a2d4b-fa11-4acd-8a27-94f9664efc13 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d3d0d44b-4a77-4a26-84df-4dcd8bc4736f tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/670a2d4b-fa11-4acd-8a27-94f9664efc13" status: 404 len: 109 microversion: 2.1 time: 0.036582 Jun 22 10:28:55.899344 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 515/1048] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jun 22 10:28:55 2022] DELETE /compute/v2.1/os-volumes/670a2d4b-fa11-4acd-8a27-94f9664efc13 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:55.901028 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b06acbcc-0106-4fea-a9d9-9330d98083dc tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Calling method '.version_select at 0x7f021fc2b310>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:55.931827 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-b06acbcc-0106-4fea-a9d9-9330d98083dc tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] HTTP exception thrown: Volume b2269368-a990-4977-afe0-35b379136e27 could not be found. Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b06acbcc-0106-4fea-a9d9-9330d98083dc tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Request method failure captured: Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/os-volumes/b2269368-a990-4977-afe0-35b379136e27 HTTP/1.1 Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu7nvExCPGvLdETSMXa7ihw3PW7539reFnLAQ65FWAWq2myYwXFQ2jNi7XhZBLWOWg9VnVDz6GAQgpIQkWIaSUlzVL4S326s6TjwCnHRqcm64ZPh0xfoXkSyO4wDcAqwEKxnOM5HVcrEOA3h_UpI0FB_9rz5s49t1ipkDBkgYvr3EoE Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: ccd78f6dc7614809ae7c3beeed092cdb Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:28:55.933903 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ccd78f6dc7614809ae7c3beeed092cdb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ccd78f6dc7614809ae7c3beeed092cdb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: ccd78f6dc7614809ae7c3beeed092cdb Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-VolumesNegativeTest-1009950857 Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-VolumesNegativeTest-1009950857-project Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: ed921b8887e44345ac543d4f97e74281 Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-VolumesNegativeTest-1009950857-project Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Volume b2269368-a990-4977-afe0-35b379136e27 could not be found. Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': 'b2269368-a990-4977-afe0-35b379136e27'} Jun 22 10:28:55.935447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2269368-a990-4977-afe0-35b379136e27 could not be found. (HTTP 404) (Request-ID: req-9bef5f26-b65d-4b5f-a00b-ca015d10201b) Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.936399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:28:55.937891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2269368-a990-4977-afe0-35b379136e27 could not be found. Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 10:28:55.939708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2269368-a990-4977-afe0-35b379136e27 could not be found. Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2269368-a990-4977-afe0-35b379136e27 could not be found. Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b06acbcc-0106-4fea-a9d9-9330d98083dc tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] Returning 404 to user: Volume b2269368-a990-4977-afe0-35b379136e27 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b06acbcc-0106-4fea-a9d9-9330d98083dc tempest-VolumesNegativeTest-1009950857 tempest-VolumesNegativeTest-1009950857-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b2269368-a990-4977-afe0-35b379136e27" status: 404 len: 109 microversion: 2.1 time: 0.038405 Jun 22 10:28:55.946800 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 534/1049] 10.222.0.46 () {58 vars in 1244 bytes} [Wed Jun 22 10:28:55 2022] GET /compute/v2.1/os-volumes/b2269368-a990-4977-afe0-35b379136e27 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:56.467840 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-23e7dec5-c062-44b6-9ea4-e74de7e27b94 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:56.468572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-23e7dec5-c062-44b6-9ea4-e74de7e27b94 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:56.480187 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-23e7dec5-c062-44b6-9ea4-e74de7e27b94 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:56.481037 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-23e7dec5-c062-44b6-9ea4-e74de7e27b94 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:56.482418 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-23e7dec5-c062-44b6-9ea4-e74de7e27b94 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:56.483417 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-23e7dec5-c062-44b6-9ea4-e74de7e27b94 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:56.633238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-23e7dec5-c062-44b6-9ea4-e74de7e27b94 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:56.640952 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-23e7dec5-c062-44b6-9ea4-e74de7e27b94 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.177513 Jun 22 10:28:56.641525 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 516/1050] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:56 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:57.655209 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:57.656749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=6 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:57.663619 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ce7b223c-0315-4a90-b71e-35670a253b95 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:57.664113 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ce7b223c-0315-4a90-b71e-35670a253b95 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:57.670646 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ce7b223c-0315-4a90-b71e-35670a253b95 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:57.671110 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ce7b223c-0315-4a90-b71e-35670a253b95 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:57.671883 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ce7b223c-0315-4a90-b71e-35670a253b95 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:57.672322 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ce7b223c-0315-4a90-b71e-35670a253b95 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:57.807533 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ce7b223c-0315-4a90-b71e-35670a253b95 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:57.815097 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ce7b223c-0315-4a90-b71e-35670a253b95 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.161054 Jun 22 10:28:57.815662 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 535/1051] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:57 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:58.835446 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f2313061-b8aa-4d11-8940-85f9357d07d2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:58.836332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f2313061-b8aa-4d11-8940-85f9357d07d2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:58.838275 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:58.845980 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f2313061-b8aa-4d11-8940-85f9357d07d2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:58.846833 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f2313061-b8aa-4d11-8940-85f9357d07d2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:58.848248 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f2313061-b8aa-4d11-8940-85f9357d07d2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:58.848923 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f2313061-b8aa-4d11-8940-85f9357d07d2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:58.997698 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f2313061-b8aa-4d11-8940-85f9357d07d2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:59.005763 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f2313061-b8aa-4d11-8940-85f9357d07d2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.174500 Jun 22 10:28:59.006482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 517/1052] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:58 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:29:00.022902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e229afbd-4f2f-4de6-b68d-0bf48efec5e4 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:00.023571 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e229afbd-4f2f-4de6-b68d-0bf48efec5e4 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:00.025956 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:00.030871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e229afbd-4f2f-4de6-b68d-0bf48efec5e4 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:00.031328 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e229afbd-4f2f-4de6-b68d-0bf48efec5e4 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:00.032103 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e229afbd-4f2f-4de6-b68d-0bf48efec5e4 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:00.033168 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e229afbd-4f2f-4de6-b68d-0bf48efec5e4 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:00.167548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-e229afbd-4f2f-4de6-b68d-0bf48efec5e4 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:00.175204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e229afbd-4f2f-4de6-b68d-0bf48efec5e4 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.156189 Jun 22 10:29:00.175765 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 536/1053] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:00 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:01.192242 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2aa26341-83e5-4e19-822b-0fa937c1e8c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:01.192867 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2aa26341-83e5-4e19-822b-0fa937c1e8c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:01.195531 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:01.200464 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2aa26341-83e5-4e19-822b-0fa937c1e8c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:01.200961 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2aa26341-83e5-4e19-822b-0fa937c1e8c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:01.201738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2aa26341-83e5-4e19-822b-0fa937c1e8c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:01.202181 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2aa26341-83e5-4e19-822b-0fa937c1e8c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:01.334108 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2aa26341-83e5-4e19-822b-0fa937c1e8c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:01.341634 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2aa26341-83e5-4e19-822b-0fa937c1e8c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.153820 Jun 22 10:29:01.342189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 518/1054] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:01 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:02.358715 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9fb38870-d0df-4291-a357-1d47a6ab7d57 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:02.359498 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9fb38870-d0df-4291-a357-1d47a6ab7d57 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:02.366701 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9fb38870-d0df-4291-a357-1d47a6ab7d57 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:02.370918 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9fb38870-d0df-4291-a357-1d47a6ab7d57 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:02.370918 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9fb38870-d0df-4291-a357-1d47a6ab7d57 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:02.370918 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9fb38870-d0df-4291-a357-1d47a6ab7d57 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:02.513156 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9fb38870-d0df-4291-a357-1d47a6ab7d57 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:02.521493 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9fb38870-d0df-4291-a357-1d47a6ab7d57 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.166854 Jun 22 10:29:02.522074 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 537/1055] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:02 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:03.539753 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2c41294c-fa43-4658-9736-ad3ed4c14efc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:03.540453 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2c41294c-fa43-4658-9736-ad3ed4c14efc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:03.547252 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c41294c-fa43-4658-9736-ad3ed4c14efc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:03.547716 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c41294c-fa43-4658-9736-ad3ed4c14efc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:03.549127 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c41294c-fa43-4658-9736-ad3ed4c14efc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:03.549635 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2c41294c-fa43-4658-9736-ad3ed4c14efc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:03.687962 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2c41294c-fa43-4658-9736-ad3ed4c14efc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:03.695664 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2c41294c-fa43-4658-9736-ad3ed4c14efc tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.160119 Jun 22 10:29:03.696232 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 519/1056] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:03 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:04.713126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3e50b588-adcb-4402-a85a-5b9215e1c2a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:04.713688 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3e50b588-adcb-4402-a85a-5b9215e1c2a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:04.720084 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3e50b588-adcb-4402-a85a-5b9215e1c2a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:04.720546 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3e50b588-adcb-4402-a85a-5b9215e1c2a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:04.721327 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3e50b588-adcb-4402-a85a-5b9215e1c2a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:04.721767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3e50b588-adcb-4402-a85a-5b9215e1c2a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:04.854563 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3e50b588-adcb-4402-a85a-5b9215e1c2a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:04.863146 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3e50b588-adcb-4402-a85a-5b9215e1c2a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.154116 Jun 22 10:29:04.863722 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 538/1057] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:04 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:05.617574 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-2e8aa49c-f317-4353-a940-9072efb5d545 req-583d9884-9a1a-4ec5-b081-3c7c5a300c1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78ebc75e-8531-4681-823f-01a293b4cdbb", "name": "network-vif-plugged", "status": "completed", "tag": "f2fcd12b-26c2-4da9-8312-532778fa247c"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:29:05.626503 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-2e8aa49c-f317-4353-a940-9072efb5d545 req-583d9884-9a1a-4ec5-b081-3c7c5a300c1c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:05.631392 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-2e8aa49c-f317-4353-a940-9072efb5d545 req-583d9884-9a1a-4ec5-b081-3c7c5a300c1c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:05.641502 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-2e8aa49c-f317-4353-a940-9072efb5d545 req-583d9884-9a1a-4ec5-b081-3c7c5a300c1c service nova] Creating event network-vif-plugged:f2fcd12b-26c2-4da9-8312-532778fa247c for instance 78ebc75e-8531-4681-823f-01a293b4cdbb on hv-cinder-84327 Jun 22 10:29:05.647539 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-2e8aa49c-f317-4353-a940-9072efb5d545 req-583d9884-9a1a-4ec5-b081-3c7c5a300c1c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033393 Jun 22 10:29:05.648498 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 520/1058] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:29:05.880040 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6c6605b6-9687-4ee8-91c3-79c7606f15a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:05.880744 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6c6605b6-9687-4ee8-91c3-79c7606f15a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:05.887468 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c6605b6-9687-4ee8-91c3-79c7606f15a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:05.887929 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c6605b6-9687-4ee8-91c3-79c7606f15a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:05.888710 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c6605b6-9687-4ee8-91c3-79c7606f15a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:05.889192 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c6605b6-9687-4ee8-91c3-79c7606f15a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:06.033210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6c6605b6-9687-4ee8-91c3-79c7606f15a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:06.039577 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6c6605b6-9687-4ee8-91c3-79c7606f15a7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.163174 Jun 22 10:29:06.040201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 539/1059] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:05 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:07.057467 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2f2d6002-2168-42f7-ad20-6fa5c6cea15d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:07.058180 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2f2d6002-2168-42f7-ad20-6fa5c6cea15d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:07.065512 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2f2d6002-2168-42f7-ad20-6fa5c6cea15d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:07.066370 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2f2d6002-2168-42f7-ad20-6fa5c6cea15d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:07.067147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2f2d6002-2168-42f7-ad20-6fa5c6cea15d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:07.067591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2f2d6002-2168-42f7-ad20-6fa5c6cea15d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:07.201230 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2f2d6002-2168-42f7-ad20-6fa5c6cea15d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:07.209346 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2f2d6002-2168-42f7-ad20-6fa5c6cea15d tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.156414 Jun 22 10:29:07.209982 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 521/1060] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:07 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:08.226722 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bf8a24f8-24ea-4d3f-bb60-c94ba1ff28f5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:08.227267 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bf8a24f8-24ea-4d3f-bb60-c94ba1ff28f5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:08.233763 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bf8a24f8-24ea-4d3f-bb60-c94ba1ff28f5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:08.234204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bf8a24f8-24ea-4d3f-bb60-c94ba1ff28f5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:08.234980 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bf8a24f8-24ea-4d3f-bb60-c94ba1ff28f5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:08.235439 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bf8a24f8-24ea-4d3f-bb60-c94ba1ff28f5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:08.369495 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bf8a24f8-24ea-4d3f-bb60-c94ba1ff28f5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:08.379411 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bf8a24f8-24ea-4d3f-bb60-c94ba1ff28f5 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1265 microversion: 2.1 time: 0.156595 Jun 22 10:29:08.380003 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 540/1061] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:08 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:09.395954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d0169abe-421e-4597-9f01-89d2e6a28fa7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:09.396559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d0169abe-421e-4597-9f01-89d2e6a28fa7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:09.403530 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d0169abe-421e-4597-9f01-89d2e6a28fa7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:09.403997 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d0169abe-421e-4597-9f01-89d2e6a28fa7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:09.407749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d0169abe-421e-4597-9f01-89d2e6a28fa7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:09.407749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d0169abe-421e-4597-9f01-89d2e6a28fa7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:09.548408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d0169abe-421e-4597-9f01-89d2e6a28fa7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:09.556345 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d0169abe-421e-4597-9f01-89d2e6a28fa7 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1452 microversion: 2.1 time: 0.164461 Jun 22 10:29:09.556983 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 522/1062] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:09 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:09.572312 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cbfe24e6-46a5-469e-8c98-553729042ae0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:09.572954 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-cbfe24e6-46a5-469e-8c98-553729042ae0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:09.579605 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cbfe24e6-46a5-469e-8c98-553729042ae0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:09.580062 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cbfe24e6-46a5-469e-8c98-553729042ae0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:09.580872 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cbfe24e6-46a5-469e-8c98-553729042ae0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:09.581321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cbfe24e6-46a5-469e-8c98-553729042ae0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:09.717853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cbfe24e6-46a5-469e-8c98-553729042ae0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:09.725925 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cbfe24e6-46a5-469e-8c98-553729042ae0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1452 microversion: 2.1 time: 0.157442 Jun 22 10:29:09.726493 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 541/1063] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:09 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:12.307316 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-85562ec2-6b3f-4348-8855-0e46b72427b5 req-f675a160-07a3-41d2-b1f1-cf24d8d9e62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ebc75e-8531-4681-823f-01a293b4cdbb", "tag": "f2fcd12b-26c2-4da9-8312-532778fa247c"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:29:12.316967 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-85562ec2-6b3f-4348-8855-0e46b72427b5 req-f675a160-07a3-41d2-b1f1-cf24d8d9e62c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:12.317416 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-85562ec2-6b3f-4348-8855-0e46b72427b5 req-f675a160-07a3-41d2-b1f1-cf24d8d9e62c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:12.328843 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-85562ec2-6b3f-4348-8855-0e46b72427b5 req-f675a160-07a3-41d2-b1f1-cf24d8d9e62c service nova] Creating event network-changed:f2fcd12b-26c2-4da9-8312-532778fa247c for instance 78ebc75e-8531-4681-823f-01a293b4cdbb on hv-cinder-84327 Jun 22 10:29:12.334157 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-85562ec2-6b3f-4348-8855-0e46b72427b5 req-f675a160-07a3-41d2-b1f1-cf24d8d9e62c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030726 Jun 22 10:29:12.334768 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 523/1064] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:29:25.874122 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b1db72ae-171b-4236-b0f3-3da2053fa664 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:25.875617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b1db72ae-171b-4236-b0f3-3da2053fa664 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:25.879456 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=11 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:25.880136 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=45 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:25.883916 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b1db72ae-171b-4236-b0f3-3da2053fa664 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:25.884614 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b1db72ae-171b-4236-b0f3-3da2053fa664 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:25.885671 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b1db72ae-171b-4236-b0f3-3da2053fa664 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:25.886114 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b1db72ae-171b-4236-b0f3-3da2053fa664 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:25.917998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b1db72ae-171b-4236-b0f3-3da2053fa664 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047798 Jun 22 10:29:25.918564 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 542/1065] 10.222.0.46 () {60 vars in 1342 bytes} [Wed Jun 22 10:29:25 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:25.978470 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=11 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:25.985460 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=63 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:25.985460 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bdd996f4-9c98-4b8a-b2d3-c4cf88e97d16 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:25.985460 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bdd996f4-9c98-4b8a-b2d3-c4cf88e97d16 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:25.990112 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bdd996f4-9c98-4b8a-b2d3-c4cf88e97d16 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:25.990566 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bdd996f4-9c98-4b8a-b2d3-c4cf88e97d16 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:25.991332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bdd996f4-9c98-4b8a-b2d3-c4cf88e97d16 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:25.991771 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bdd996f4-9c98-4b8a-b2d3-c4cf88e97d16 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:26.018079 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bdd996f4-9c98-4b8a-b2d3-c4cf88e97d16 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:29:26.379316 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bdd996f4-9c98-4b8a-b2d3-c4cf88e97d16 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "DELETE /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 204 len: 0 microversion: 2.20 time: 0.402147 Jun 22 10:29:26.379909 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 524/1066] 10.222.0.46 () {60 vars in 1279 bytes} [Wed Jun 22 10:29:25 2022] DELETE /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 10:29:26.388498 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-52ead240-eb4e-4f37-b4e3-789ccbaf962b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:26.389155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-52ead240-eb4e-4f37-b4e3-789ccbaf962b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:26.395920 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-52ead240-eb4e-4f37-b4e3-789ccbaf962b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:26.396370 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-52ead240-eb4e-4f37-b4e3-789ccbaf962b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:26.397169 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-52ead240-eb4e-4f37-b4e3-789ccbaf962b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:26.397615 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-52ead240-eb4e-4f37-b4e3-789ccbaf962b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:26.527208 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-52ead240-eb4e-4f37-b4e3-789ccbaf962b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:26.535391 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-52ead240-eb4e-4f37-b4e3-789ccbaf962b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:26.536937 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-52ead240-eb4e-4f37-b4e3-789ccbaf962b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:26.538137 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-52ead240-eb4e-4f37-b4e3-789ccbaf962b tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.153935 Jun 22 10:29:26.538701 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 543/1067] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:29:26 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:29:27.556970 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-18033829-f688-41e1-9b12-7c242c448691 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:27.557585 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-18033829-f688-41e1-9b12-7c242c448691 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:27.565447 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-18033829-f688-41e1-9b12-7c242c448691 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:27.565895 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-18033829-f688-41e1-9b12-7c242c448691 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:27.572219 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-18033829-f688-41e1-9b12-7c242c448691 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:27.572662 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-18033829-f688-41e1-9b12-7c242c448691 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:27.715268 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-18033829-f688-41e1-9b12-7c242c448691 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:27.723989 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-18033829-f688-41e1-9b12-7c242c448691 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:27.725524 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-18033829-f688-41e1-9b12-7c242c448691 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:27.726704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-18033829-f688-41e1-9b12-7c242c448691 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.174192 Jun 22 10:29:27.736233 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 525/1068] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:29:27 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:29:28.744611 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9efac319-75e7-4ef1-b855-18ca95e8a5d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:28.745228 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9efac319-75e7-4ef1-b855-18ca95e8a5d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:28.752588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9efac319-75e7-4ef1-b855-18ca95e8a5d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:28.753387 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9efac319-75e7-4ef1-b855-18ca95e8a5d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:28.754070 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9efac319-75e7-4ef1-b855-18ca95e8a5d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:28.754509 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9efac319-75e7-4ef1-b855-18ca95e8a5d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:28.901292 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9efac319-75e7-4ef1-b855-18ca95e8a5d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:28.910923 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9efac319-75e7-4ef1-b855-18ca95e8a5d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:28.912352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9efac319-75e7-4ef1-b855-18ca95e8a5d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:28.913583 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9efac319-75e7-4ef1-b855-18ca95e8a5d9 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1722 microversion: 2.20 time: 0.173362 Jun 22 10:29:28.914138 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 544/1069] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:29:28 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:29:29.395914 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-0dd31abe-bd4a-444e-adb2-c50ccd0451ee req-76461b81-e020-497c-8e81-63e09148f48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e", "name": "network-vif-deleted", "tag": "dbfaa146-96f3-4722-9a6e-f6764ddb4ef2"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:29:29.404680 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-0dd31abe-bd4a-444e-adb2-c50ccd0451ee req-76461b81-e020-497c-8e81-63e09148f48c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:29.405271 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-0dd31abe-bd4a-444e-adb2-c50ccd0451ee req-76461b81-e020-497c-8e81-63e09148f48c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:29.418559 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-0dd31abe-bd4a-444e-adb2-c50ccd0451ee req-76461b81-e020-497c-8e81-63e09148f48c service nova] Creating event network-vif-deleted:dbfaa146-96f3-4722-9a6e-f6764ddb4ef2 for instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e on hv-cinder-84327 Jun 22 10:29:29.423956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-0dd31abe-bd4a-444e-adb2-c50ccd0451ee req-76461b81-e020-497c-8e81-63e09148f48c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198573 Jun 22 10:29:29.424946 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 526/1070] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:29:29.933605 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:29.934708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:29.942167 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:29.942619 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:29.943490 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:29.943962 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:29.976459 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:29.976954 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:29.977418 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lazy-loading 'fault' on Instance uuid 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:29:30.019402 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:30.027452 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:30.029052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef533d7373946dcb340fbf496070e9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fed4f483e84ec7a10b96de33677cbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:30.030453 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ea7d4656-8019-435b-8355-346bef098bb8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 200 len: 1371 microversion: 2.20 time: 0.101240 Jun 22 10:29:30.030806 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 545/1071] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:29:29 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:29:31.048439 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0d21ab3e-1ac0-4f07-9aca-9ec23587609e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:31.049147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0d21ab3e-1ac0-4f07-9aca-9ec23587609e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:31.055833 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0d21ab3e-1ac0-4f07-9aca-9ec23587609e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:31.056273 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0d21ab3e-1ac0-4f07-9aca-9ec23587609e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:31.057067 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0d21ab3e-1ac0-4f07-9aca-9ec23587609e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:31.057501 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0d21ab3e-1ac0-4f07-9aca-9ec23587609e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:31.073437 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-0d21ab3e-1ac0-4f07-9aca-9ec23587609e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] HTTP exception thrown: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0d21ab3e-1ac0-4f07-9aca-9ec23587609e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Request method failure captured: Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e HTTP/1.1 Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisux88luJMz48v1B7FXhyA5Io-xLo6beC-rU41S5hxsLUNac1d5NSKUY62KeC6KE1TTy3RhUiiERYbxKsKKsmIdEAiYCy9Q_H3dcXtkdEB8xLUPktZWEbldETa9F9a2ADVwYo6GNu1OWuum1EmybzP8EoHjjxiiyDledLo9m8ZB6ImZM Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: b3fed4f483e84ec7a10b96de33677cbc Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:29:31.075045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:29:31.076738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3fed4f483e84ec7a10b96de33677cbc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:29:31.076738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:31.076738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: b3fed4f483e84ec7a10b96de33677cbc Jun 22 10:29:31.076738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:31.076738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeShelveTestJSON-517259058-project Jun 22 10:29:31.076738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:29:31.076738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:29:31.076738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: cef533d7373946dcb340fbf496070e9f Jun 22 10:29:31.076738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeShelveTestJSON-517259058-project Jun 22 10:29:31.076738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:29:31.076738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:31.076738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e'} Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:29:31.077826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:31.080034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:31.081813 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0d21ab3e-1ac0-4f07-9aca-9ec23587609e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Returning 404 to user: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:29:31.081813 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0d21ab3e-1ac0-4f07-9aca-9ec23587609e tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 404 len: 111 microversion: 2.20 time: 0.032210 Jun 22 10:29:31.081813 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 527/1072] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:29:31 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:29:31.086257 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-de6bd295-ea07-4e2c-a228-0de8c553cad1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '.version_select at 0x7f021fd5c790>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:31.203168 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-de6bd295-ea07-4e2c-a228-0de8c553cad1 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562922999" status: 204 len: 0 microversion: 2.20 time: 0.121062 Jun 22 10:29:31.204364 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 546/1073] 10.222.0.46 () {60 vars in 1261 bytes} [Wed Jun 22 10:29:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1562922999 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 22 10:29:33.359688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b8237b84-d1ee-4873-96da-15efedb64db2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:33.360785 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b8237b84-d1ee-4873-96da-15efedb64db2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:33.367293 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b8237b84-d1ee-4873-96da-15efedb64db2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:33.371825 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b8237b84-d1ee-4873-96da-15efedb64db2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:33.371825 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b8237b84-d1ee-4873-96da-15efedb64db2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:33.371825 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b8237b84-d1ee-4873-96da-15efedb64db2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:33.384021 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-b8237b84-d1ee-4873-96da-15efedb64db2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] HTTP exception thrown: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b8237b84-d1ee-4873-96da-15efedb64db2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Request method failure captured: Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: DELETE /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e HTTP/1.1 Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisux88luJMz48v1B7FXhyA5Io-xLo6beC-rU41S5hxsLUNac1d5NSKUY62KeC6KE1TTy3RhUiiERYbxKsKKsmIdEAiYCy9Q_H3dcXtkdEB8xLUPktZWEbldETa9F9a2ADVwYo6GNu1OWuum1EmybzP8EoHjjxiiyDledLo9m8ZB6ImZM Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: b3fed4f483e84ec7a10b96de33677cbc Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:29:33.385802 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:29:33.387225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3fed4f483e84ec7a10b96de33677cbc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:29:33.387225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:33.387225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: b3fed4f483e84ec7a10b96de33677cbc Jun 22 10:29:33.387225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:33.387225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeShelveTestJSON-517259058-project Jun 22 10:29:33.387225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:29:33.387225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:29:33.387225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: cef533d7373946dcb340fbf496070e9f Jun 22 10:29:33.387225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeShelveTestJSON-517259058-project Jun 22 10:29:33.387225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:29:33.387225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:33.387225 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e'} Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:29:33.388182 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:33.390264 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:33.392617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b8237b84-d1ee-4873-96da-15efedb64db2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Returning 404 to user: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:29:33.392617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b8237b84-d1ee-4873-96da-15efedb64db2 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "DELETE /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 404 len: 111 microversion: 2.20 time: 0.031610 Jun 22 10:29:33.392617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 528/1074] 10.222.0.46 () {60 vars in 1279 bytes} [Wed Jun 22 10:29:33 2022] DELETE /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:29:33.396656 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c430e4a7-4ee2-418c-9bad-0147f6e9f6e3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:33.397329 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c430e4a7-4ee2-418c-9bad-0147f6e9f6e3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:33.405886 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c430e4a7-4ee2-418c-9bad-0147f6e9f6e3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:33.406368 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c430e4a7-4ee2-418c-9bad-0147f6e9f6e3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:33.407236 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c430e4a7-4ee2-418c-9bad-0147f6e9f6e3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:33.407931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c430e4a7-4ee2-418c-9bad-0147f6e9f6e3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:33.422185 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-c430e4a7-4ee2-418c-9bad-0147f6e9f6e3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] HTTP exception thrown: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c430e4a7-4ee2-418c-9bad-0147f6e9f6e3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Request method failure captured: Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e HTTP/1.1 Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisux88luJMz48v1B7FXhyA5Io-xLo6beC-rU41S5hxsLUNac1d5NSKUY62KeC6KE1TTy3RhUiiERYbxKsKKsmIdEAiYCy9Q_H3dcXtkdEB8xLUPktZWEbldETa9F9a2ADVwYo6GNu1OWuum1EmybzP8EoHjjxiiyDledLo9m8ZB6ImZM Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: b3fed4f483e84ec7a10b96de33677cbc Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:29:33.423736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:29:33.425539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3fed4f483e84ec7a10b96de33677cbc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:29:33.425539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:33.425539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: b3fed4f483e84ec7a10b96de33677cbc Jun 22 10:29:33.425539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:33.425539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-AttachVolumeShelveTestJSON-517259058-project Jun 22 10:29:33.425539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:29:33.425539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:29:33.425539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: cef533d7373946dcb340fbf496070e9f Jun 22 10:29:33.425539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-AttachVolumeShelveTestJSON-517259058-project Jun 22 10:29:33.425539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:29:33.425539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:33.425539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e'} Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:29:33.426326 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. Jun 22 10:29:33.427655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:29:33.428746 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c430e4a7-4ee2-418c-9bad-0147f6e9f6e3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Returning 404 to user: Instance 20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:29:33.428746 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c430e4a7-4ee2-418c-9bad-0147f6e9f6e3 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e" status: 404 len: 111 microversion: 2.20 time: 0.032346 Jun 22 10:29:33.428746 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 547/1075] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:29:33 2022] GET /compute/v2.1/servers/20bfa2d5-cd78-4b4d-a5f6-e5360f75d35e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:29:35.789774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7831bd54-a2aa-4629-b9cb-0b826ebe783a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:35.790303 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7831bd54-a2aa-4629-b9cb-0b826ebe783a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:35.796990 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7831bd54-a2aa-4629-b9cb-0b826ebe783a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:35.797471 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7831bd54-a2aa-4629-b9cb-0b826ebe783a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:35.798232 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7831bd54-a2aa-4629-b9cb-0b826ebe783a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:35.798674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7831bd54-a2aa-4629-b9cb-0b826ebe783a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:35.813197 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-7831bd54-a2aa-4629-b9cb-0b826ebe783a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] HTTP exception thrown: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7831bd54-a2aa-4629-b9cb-0b826ebe783a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Request method failure captured: Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: DELETE /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f HTTP/1.1 Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisux88luJMz48v1B7FXhyA5Io-xLo6beC-rU41S5hxsLUNac1d5NSKUY62KeC6KE1TTy3RhUiiERYbxKsKKsmIdEAiYCy9Q_H3dcXtkdEB8xLUPktZWEbldETa9F9a2ADVwYo6GNu1OWuum1EmybzP8EoHjjxiiyDledLo9m8ZB6ImZM Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: b3fed4f483e84ec7a10b96de33677cbc Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:29:35.815257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:29:35.816777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3fed4f483e84ec7a10b96de33677cbc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:29:35.816777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:35.816777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: b3fed4f483e84ec7a10b96de33677cbc Jun 22 10:29:35.816777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:35.816777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeShelveTestJSON-517259058-project Jun 22 10:29:35.816777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:29:35.816777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:29:35.816777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: cef533d7373946dcb340fbf496070e9f Jun 22 10:29:35.816777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeShelveTestJSON-517259058-project Jun 22 10:29:35.816777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:29:35.816777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:29:35.816777 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '86fa8c96-e39d-47ce-86a0-9d7d7eaf099f'} Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:29:35.817623 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:29:35.819051 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:29:35.820573 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7831bd54-a2aa-4629-b9cb-0b826ebe783a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Returning 404 to user: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:29:35.820573 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7831bd54-a2aa-4629-b9cb-0b826ebe783a tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "DELETE /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 404 len: 111 microversion: 2.20 time: 0.030899 Jun 22 10:29:35.820573 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 529/1076] 10.222.0.46 () {60 vars in 1279 bytes} [Wed Jun 22 10:29:35 2022] DELETE /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:29:35.825429 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d8d7714c-b121-43e9-8167-32b456914ec8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:35.826051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d8d7714c-b121-43e9-8167-32b456914ec8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] [instance: 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:35.833269 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8d7714c-b121-43e9-8167-32b456914ec8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:35.833783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8d7714c-b121-43e9-8167-32b456914ec8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:35.834566 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8d7714c-b121-43e9-8167-32b456914ec8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:35.835011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8d7714c-b121-43e9-8167-32b456914ec8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:35.850321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-d8d7714c-b121-43e9-8167-32b456914ec8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] HTTP exception thrown: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d8d7714c-b121-43e9-8167-32b456914ec8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Request method failure captured: Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f HTTP/1.1 Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisux88luJMz48v1B7FXhyA5Io-xLo6beC-rU41S5hxsLUNac1d5NSKUY62KeC6KE1TTy3RhUiiERYbxKsKKsmIdEAiYCy9Q_H3dcXtkdEB8xLUPktZWEbldETa9F9a2ADVwYo6GNu1OWuum1EmybzP8EoHjjxiiyDledLo9m8ZB6ImZM Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: b3fed4f483e84ec7a10b96de33677cbc Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:29:35.851853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:29:35.853547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_b3fed4f483e84ec7a10b96de33677cbc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/b3fed4f483e84ec7a10b96de33677cbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:29:35.853547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:35.853547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: b3fed4f483e84ec7a10b96de33677cbc Jun 22 10:29:35.853547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-517259058 Jun 22 10:29:35.853547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-AttachVolumeShelveTestJSON-517259058-project Jun 22 10:29:35.853547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:29:35.853547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:29:35.853547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: cef533d7373946dcb340fbf496070e9f Jun 22 10:29:35.853547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-AttachVolumeShelveTestJSON-517259058-project Jun 22 10:29:35.853547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:29:35.853547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:29:35.853547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '86fa8c96-e39d-47ce-86a0-9d7d7eaf099f'} Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:29:35.854408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. Jun 22 10:29:35.855717 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:29:35.856767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d8d7714c-b121-43e9-8167-32b456914ec8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] Returning 404 to user: Instance 86fa8c96-e39d-47ce-86a0-9d7d7eaf099f could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:29:35.856767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d8d7714c-b121-43e9-8167-32b456914ec8 tempest-AttachVolumeShelveTestJSON-517259058 tempest-AttachVolumeShelveTestJSON-517259058-project] 10.222.0.46 "GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f" status: 404 len: 111 microversion: 2.20 time: 0.031965 Jun 22 10:29:35.856767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 548/1077] 10.222.0.46 () {60 vars in 1276 bytes} [Wed Jun 22 10:29:35 2022] GET /compute/v2.1/servers/86fa8c96-e39d-47ce-86a0-9d7d7eaf099f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:30:21.094919 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4125809b-348e-45c0-b3ed-45920ecacc33 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:21.095490 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4125809b-348e-45c0-b3ed-45920ecacc33 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:21.097553 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:21.098226 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:21.103088 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4125809b-348e-45c0-b3ed-45920ecacc33 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:21.103543 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4125809b-348e-45c0-b3ed-45920ecacc33 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:21.105040 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4125809b-348e-45c0-b3ed-45920ecacc33 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:21.105040 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4125809b-348e-45c0-b3ed-45920ecacc33 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:21.128149 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4125809b-348e-45c0-b3ed-45920ecacc33 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11/ips" status: 200 len: 150 microversion: 2.1 time: 0.037279 Jun 22 10:30:21.128717 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 530/1078] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jun 22 10:30:21 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:21.140376 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-42d7dc2e-852b-4136-9a71-7fcb0ee0acad tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffe84785-e866-4753-95d2-951cc9a14801"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:21.141552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-42d7dc2e-852b-4136-9a71-7fcb0ee0acad tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:21.143550 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:21.144207 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=30 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:21.149048 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-42d7dc2e-852b-4136-9a71-7fcb0ee0acad tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:21.149496 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-42d7dc2e-852b-4136-9a71-7fcb0ee0acad tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:21.150287 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-42d7dc2e-852b-4136-9a71-7fcb0ee0acad tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:21.150715 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-42d7dc2e-852b-4136-9a71-7fcb0ee0acad tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:21.235081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-42d7dc2e-852b-4136-9a71-7fcb0ee0acad tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Invalid volume: volume ffe84785-e866-4753-95d2-951cc9a14801 is already attached to instances: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-42d7dc2e-852b-4136-9a71-7fcb0ee0acad tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: POST /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11/os-volume_attachments HTTP/1.1 Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 74 Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:30:21.236692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:30:21.245081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:30:21.245081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:30:21.245081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:30:21.245081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:30:21.245081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:30:21.245081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:30:21.245081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:30:21.245081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:30:21.245081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:30:21.245081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Jun 22 10:30:21.245081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {"volumeAttachment": {"volumeId": "ffe84785-e866-4753-95d2-951cc9a14801"}} Jun 22 10:30:21.245081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Invalid volume: volume ffe84785-e866-4753-95d2-951cc9a14801 is already attached to instances: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'server_id': '7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11', 'body': {'volumeAttachment': {'volumeId': 'ffe84785-e866-4753-95d2-951cc9a14801'}}} Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ffe84785-e866-4753-95d2-951cc9a14801 is already attached to instances: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:30:21.246027 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ffe84785-e866-4753-95d2-951cc9a14801 is already attached to instances: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:21.247560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:30:21.249101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:30:21.249101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:30:21.249101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:30:21.249101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ffe84785-e866-4753-95d2-951cc9a14801 is already attached to instances: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 Jun 22 10:30:21.249101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:30:21.249101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-42d7dc2e-852b-4136-9a71-7fcb0ee0acad tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 400 to user: Invalid volume: volume ffe84785-e866-4753-95d2-951cc9a14801 is already attached to instances: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:30:21.249101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-42d7dc2e-852b-4136-9a71-7fcb0ee0acad tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102272 Jun 22 10:30:21.249101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 549/1079] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:30:21 2022] POST /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 10:30:21.249647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-80becd64-1d41-4f42-baa7-6de5772d84b3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:21.249647 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-80becd64-1d41-4f42-baa7-6de5772d84b3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:21.256165 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80becd64-1d41-4f42-baa7-6de5772d84b3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:21.256622 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80becd64-1d41-4f42-baa7-6de5772d84b3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:21.257414 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80becd64-1d41-4f42-baa7-6de5772d84b3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:21.257852 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-80becd64-1d41-4f42-baa7-6de5772d84b3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:21.284064 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-80becd64-1d41-4f42-baa7-6de5772d84b3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:30:21.628913 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-80becd64-1d41-4f42-baa7-6de5772d84b3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 204 len: 0 microversion: 2.1 time: 0.385397 Jun 22 10:30:21.629497 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 531/1080] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:30:21 2022] DELETE /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:30:21.637787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0acd7d0e-743d-4f29-9560-42faffae94b9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:21.639857 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0acd7d0e-743d-4f29-9560-42faffae94b9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:21.645905 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0acd7d0e-743d-4f29-9560-42faffae94b9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:21.646338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0acd7d0e-743d-4f29-9560-42faffae94b9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:21.647102 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0acd7d0e-743d-4f29-9560-42faffae94b9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:21.647535 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0acd7d0e-743d-4f29-9560-42faffae94b9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:21.782407 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0acd7d0e-743d-4f29-9560-42faffae94b9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:21.790044 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0acd7d0e-743d-4f29-9560-42faffae94b9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1682 microversion: 2.1 time: 0.156097 Jun 22 10:30:21.791117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 550/1081] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:21 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:22.808726 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4c932584-4253-4a18-bc80-9dfc7083e7b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:22.809462 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4c932584-4253-4a18-bc80-9dfc7083e7b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:22.816575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4c932584-4253-4a18-bc80-9dfc7083e7b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:22.817055 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4c932584-4253-4a18-bc80-9dfc7083e7b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:22.817836 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4c932584-4253-4a18-bc80-9dfc7083e7b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:22.818279 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4c932584-4253-4a18-bc80-9dfc7083e7b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:22.959963 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4c932584-4253-4a18-bc80-9dfc7083e7b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:22.967783 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4c932584-4253-4a18-bc80-9dfc7083e7b1 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1682 microversion: 2.1 time: 0.163842 Jun 22 10:30:22.968359 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 532/1082] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:22 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:23.987761 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-fbb63744-74f1-4ae3-a929-8c553cb5d249 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:23.988379 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-fbb63744-74f1-4ae3-a929-8c553cb5d249 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:23.995825 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fbb63744-74f1-4ae3-a929-8c553cb5d249 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:23.996951 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fbb63744-74f1-4ae3-a929-8c553cb5d249 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:23.997152 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fbb63744-74f1-4ae3-a929-8c553cb5d249 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:23.997483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-fbb63744-74f1-4ae3-a929-8c553cb5d249 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:24.129532 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-fbb63744-74f1-4ae3-a929-8c553cb5d249 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:24.137086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-fbb63744-74f1-4ae3-a929-8c553cb5d249 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1682 microversion: 2.1 time: 0.153619 Jun 22 10:30:24.137658 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 551/1083] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:23 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:25.154296 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e82336d7-87c3-4a36-b7fb-9f8556a15633 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:25.155207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e82336d7-87c3-4a36-b7fb-9f8556a15633 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:25.161994 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e82336d7-87c3-4a36-b7fb-9f8556a15633 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:25.164272 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e82336d7-87c3-4a36-b7fb-9f8556a15633 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:25.164272 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e82336d7-87c3-4a36-b7fb-9f8556a15633 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:25.164272 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e82336d7-87c3-4a36-b7fb-9f8556a15633 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:25.300445 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e82336d7-87c3-4a36-b7fb-9f8556a15633 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:25.309362 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e82336d7-87c3-4a36-b7fb-9f8556a15633 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1682 microversion: 2.1 time: 0.158898 Jun 22 10:30:25.330596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 533/1084] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:25 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:26.326924 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-04a767b3-a0d0-462a-bfae-ec8f8eb082d2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:26.327692 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-04a767b3-a0d0-462a-bfae-ec8f8eb082d2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:26.334201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-04a767b3-a0d0-462a-bfae-ec8f8eb082d2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:26.334669 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-04a767b3-a0d0-462a-bfae-ec8f8eb082d2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:26.335460 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-04a767b3-a0d0-462a-bfae-ec8f8eb082d2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:26.335901 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-04a767b3-a0d0-462a-bfae-ec8f8eb082d2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:26.421637 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-04a767b3-a0d0-462a-bfae-ec8f8eb082d2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:26.437002 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-f9eb18da-5ed0-4265-b1a6-ef9a23370e23 req-1bd76ed9-ae23-4f2a-8e68-9c8404e96152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11", "name": "network-vif-deleted", "tag": "64e04080-4795-49e9-b33a-4db1c06fc4c5"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:26.444765 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-04a767b3-a0d0-462a-bfae-ec8f8eb082d2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1614 microversion: 2.1 time: 0.122122 Jun 22 10:30:26.446330 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 552/1085] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:26 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1614 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:26.448221 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-f9eb18da-5ed0-4265-b1a6-ef9a23370e23 req-1bd76ed9-ae23-4f2a-8e68-9c8404e96152 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:26.448908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-f9eb18da-5ed0-4265-b1a6-ef9a23370e23 req-1bd76ed9-ae23-4f2a-8e68-9c8404e96152 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:26.461399 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-f9eb18da-5ed0-4265-b1a6-ef9a23370e23 req-1bd76ed9-ae23-4f2a-8e68-9c8404e96152 service nova] Creating event network-vif-deleted:64e04080-4795-49e9-b33a-4db1c06fc4c5 for instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 on hv-cinder-84327 Jun 22 10:30:26.467280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-f9eb18da-5ed0-4265-b1a6-ef9a23370e23 req-1bd76ed9-ae23-4f2a-8e68-9c8404e96152 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034029 Jun 22 10:30:26.467893 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 534/1086] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:30:27.462787 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-732479ed-0cef-411c-afb8-72c693c440de tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:27.463408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-732479ed-0cef-411c-afb8-72c693c440de tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:27.470765 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-732479ed-0cef-411c-afb8-72c693c440de tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:27.471282 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-732479ed-0cef-411c-afb8-72c693c440de tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:27.472173 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-732479ed-0cef-411c-afb8-72c693c440de tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:27.472837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-732479ed-0cef-411c-afb8-72c693c440de tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:27.507260 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-732479ed-0cef-411c-afb8-72c693c440de tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:27.507797 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-732479ed-0cef-411c-afb8-72c693c440de tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:27.508309 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-732479ed-0cef-411c-afb8-72c693c440de tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lazy-loading 'fault' on Instance uuid 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:30:27.552438 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-732479ed-0cef-411c-afb8-72c693c440de tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:27.561328 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-732479ed-0cef-411c-afb8-72c693c440de tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 200 len: 1331 microversion: 2.1 time: 0.102296 Jun 22 10:30:27.561914 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 553/1087] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:27 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:28.579834 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-641d2ce6-7b9a-400f-a7ad-a1d0f4030646 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:28.580656 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-641d2ce6-7b9a-400f-a7ad-a1d0f4030646 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:28.587362 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-641d2ce6-7b9a-400f-a7ad-a1d0f4030646 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:28.587816 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-641d2ce6-7b9a-400f-a7ad-a1d0f4030646 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:28.592555 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-641d2ce6-7b9a-400f-a7ad-a1d0f4030646 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:28.592555 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-641d2ce6-7b9a-400f-a7ad-a1d0f4030646 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:28.603060 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-641d2ce6-7b9a-400f-a7ad-a1d0f4030646 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-641d2ce6-7b9a-400f-a7ad-a1d0f4030646 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 HTTP/1.1 Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:30:28.604738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:30:28.606419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:30:28.606419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:30:28.606419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:30:28.606419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:30:28.606419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:30:28.606419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:30:28.606419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:30:28.606419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:30:28.606419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:30:28.606419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:30:28.606419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:30:28.606419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11'} Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:30:28.607291 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:30:28.608837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:30:28.611270 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-641d2ce6-7b9a-400f-a7ad-a1d0f4030646 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 404 to user: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:30:28.611270 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-641d2ce6-7b9a-400f-a7ad-a1d0f4030646 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 404 len: 111 microversion: 2.1 time: 0.030552 Jun 22 10:30:28.611270 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 535/1088] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:28 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:30:28.615228 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0453e680-4ee5-4cc9-a437-e9030175ad01 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '.version_select at 0x7f021fcc1310>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:28.709948 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0453e680-4ee5-4cc9-a437-e9030175ad01 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683073988" status: 202 len: 0 microversion: 2.1 time: 0.098666 Jun 22 10:30:28.713795 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 554/1089] 10.222.0.46 () {58 vars in 1220 bytes} [Wed Jun 22 10:30:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683073988 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:30:29.582860 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-778c0914-afea-45ef-8d41-4d9a454c8dc7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:29.583413 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-778c0914-afea-45ef-8d41-4d9a454c8dc7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:29.590619 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-778c0914-afea-45ef-8d41-4d9a454c8dc7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:29.591059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-778c0914-afea-45ef-8d41-4d9a454c8dc7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:29.591872 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-778c0914-afea-45ef-8d41-4d9a454c8dc7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:29.592361 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-778c0914-afea-45ef-8d41-4d9a454c8dc7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:29.683588 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-778c0914-afea-45ef-8d41-4d9a454c8dc7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lazy-loading 'services' on Instance uuid 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:30:29.897361 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-778c0914-afea-45ef-8d41-4d9a454c8dc7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/os-volume_attachments/ffe84785-e866-4753-95d2-951cc9a14801" status: 202 len: 0 microversion: 2.1 time: 0.318263 Jun 22 10:30:29.899145 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 536/1090] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jun 22 10:30:29 2022] DELETE /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/os-volume_attachments/ffe84785-e866-4753-95d2-951cc9a14801 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:30:29.909454 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2fd4d3f0-211d-4724-a43f-6e54127f87a4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:29.911094 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2fd4d3f0-211d-4724-a43f-6e54127f87a4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:29.919375 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2fd4d3f0-211d-4724-a43f-6e54127f87a4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:29.919834 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2fd4d3f0-211d-4724-a43f-6e54127f87a4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:29.920597 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2fd4d3f0-211d-4724-a43f-6e54127f87a4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:29.921255 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2fd4d3f0-211d-4724-a43f-6e54127f87a4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:29.953142 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2fd4d3f0-211d-4724-a43f-6e54127f87a4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048705 Jun 22 10:30:29.954259 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 555/1091] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:30:29 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:30.970171 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-19b686ff-bcad-4b28-9cff-b0f79b1c7ccf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:30.970171 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-19b686ff-bcad-4b28-9cff-b0f79b1c7ccf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:30.974892 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-19b686ff-bcad-4b28-9cff-b0f79b1c7ccf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:30.975473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-19b686ff-bcad-4b28-9cff-b0f79b1c7ccf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:30.976130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-19b686ff-bcad-4b28-9cff-b0f79b1c7ccf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:30.976693 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-19b686ff-bcad-4b28-9cff-b0f79b1c7ccf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:31.009952 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-19b686ff-bcad-4b28-9cff-b0f79b1c7ccf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048472 Jun 22 10:30:31.010848 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 537/1092] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:30:30 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:32.022189 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2ccbec66-e124-4480-aec9-3cef0ad4c68c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:32.023121 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2ccbec66-e124-4480-aec9-3cef0ad4c68c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:32.031026 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2ccbec66-e124-4480-aec9-3cef0ad4c68c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:32.031521 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2ccbec66-e124-4480-aec9-3cef0ad4c68c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:32.032482 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2ccbec66-e124-4480-aec9-3cef0ad4c68c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:32.033103 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2ccbec66-e124-4480-aec9-3cef0ad4c68c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:32.069230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2ccbec66-e124-4480-aec9-3cef0ad4c68c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051168 Jun 22 10:30:32.069820 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 556/1093] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:30:32 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:30:32.140572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-776933e4-42ee-471d-850d-ffce3350841b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:32.140572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-776933e4-42ee-471d-850d-ffce3350841b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:32.145249 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-776933e4-42ee-471d-850d-ffce3350841b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:32.146034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-776933e4-42ee-471d-850d-ffce3350841b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:32.146918 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-776933e4-42ee-471d-850d-ffce3350841b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:32.147335 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-776933e4-42ee-471d-850d-ffce3350841b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:32.175900 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-776933e4-42ee-471d-850d-ffce3350841b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:30:32.657581 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-776933e4-42ee-471d-850d-ffce3350841b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 204 len: 0 microversion: 2.1 time: 0.530324 Jun 22 10:30:32.658655 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 538/1094] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:30:32 2022] DELETE /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:30:32.683016 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b9f4b27d-049f-4ae6-a8ba-c8977f501271 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:32.683016 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b9f4b27d-049f-4ae6-a8ba-c8977f501271 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:32.683016 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b9f4b27d-049f-4ae6-a8ba-c8977f501271 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:32.683016 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b9f4b27d-049f-4ae6-a8ba-c8977f501271 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:32.683676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b9f4b27d-049f-4ae6-a8ba-c8977f501271 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:32.683676 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b9f4b27d-049f-4ae6-a8ba-c8977f501271 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:32.817338 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b9f4b27d-049f-4ae6-a8ba-c8977f501271 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:32.825093 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b9f4b27d-049f-4ae6-a8ba-c8977f501271 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1679 microversion: 2.1 time: 0.158866 Jun 22 10:30:32.825590 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 557/1095] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:32 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:33.843204 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e9d9702b-eca6-44a4-9513-f0902ccc8092 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:33.843950 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e9d9702b-eca6-44a4-9513-f0902ccc8092 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:33.851167 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e9d9702b-eca6-44a4-9513-f0902ccc8092 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:33.851622 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e9d9702b-eca6-44a4-9513-f0902ccc8092 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:33.852396 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e9d9702b-eca6-44a4-9513-f0902ccc8092 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:33.852853 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e9d9702b-eca6-44a4-9513-f0902ccc8092 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:33.992500 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e9d9702b-eca6-44a4-9513-f0902ccc8092 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:34.001379 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e9d9702b-eca6-44a4-9513-f0902ccc8092 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1679 microversion: 2.1 time: 0.162392 Jun 22 10:30:34.001782 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 539/1096] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:33 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:35.022205 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2522bf2b-302b-496a-ad85-2d7f3d3e7fe4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:35.022205 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2522bf2b-302b-496a-ad85-2d7f3d3e7fe4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:35.025179 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2522bf2b-302b-496a-ad85-2d7f3d3e7fe4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:35.025640 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2522bf2b-302b-496a-ad85-2d7f3d3e7fe4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:35.026428 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2522bf2b-302b-496a-ad85-2d7f3d3e7fe4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:35.026871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2522bf2b-302b-496a-ad85-2d7f3d3e7fe4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:35.165976 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2522bf2b-302b-496a-ad85-2d7f3d3e7fe4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:35.175229 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2522bf2b-302b-496a-ad85-2d7f3d3e7fe4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1679 microversion: 2.1 time: 0.160546 Jun 22 10:30:35.175818 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 558/1097] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:35 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:36.193417 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-452720e8-1d22-4f48-9e6c-e6401500e2e6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:36.194270 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-452720e8-1d22-4f48-9e6c-e6401500e2e6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:36.204214 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-452720e8-1d22-4f48-9e6c-e6401500e2e6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:36.209858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-452720e8-1d22-4f48-9e6c-e6401500e2e6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:36.209858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-452720e8-1d22-4f48-9e6c-e6401500e2e6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:36.209858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-452720e8-1d22-4f48-9e6c-e6401500e2e6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:36.353282 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-452720e8-1d22-4f48-9e6c-e6401500e2e6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:36.362000 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-452720e8-1d22-4f48-9e6c-e6401500e2e6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1679 microversion: 2.1 time: 0.172610 Jun 22 10:30:36.364887 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 540/1098] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:36 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:37.381516 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5252fbaa-8f69-4fd6-b55e-64697e503d8d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:37.382207 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5252fbaa-8f69-4fd6-b55e-64697e503d8d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:37.389116 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5252fbaa-8f69-4fd6-b55e-64697e503d8d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:37.389594 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5252fbaa-8f69-4fd6-b55e-64697e503d8d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:37.390427 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5252fbaa-8f69-4fd6-b55e-64697e503d8d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:37.390865 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5252fbaa-8f69-4fd6-b55e-64697e503d8d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:37.532271 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5252fbaa-8f69-4fd6-b55e-64697e503d8d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:37.539986 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5252fbaa-8f69-4fd6-b55e-64697e503d8d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1679 microversion: 2.1 time: 0.163980 Jun 22 10:30:37.540553 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 559/1099] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:37 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:37.894954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-03664ac6-3154-4662-b61b-3cc0e2cc724c req-e1d78abd-8903-427e-bf6f-d8d00b327bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e62bb2-0dfd-4516-a97a-68aa18a98fe6", "name": "network-vif-deleted", "tag": "0486dca9-9f57-4bbf-b5a9-72b4e774aea0"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:37.911519 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-03664ac6-3154-4662-b61b-3cc0e2cc724c req-e1d78abd-8903-427e-bf6f-d8d00b327bab service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:37.912881 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-03664ac6-3154-4662-b61b-3cc0e2cc724c req-e1d78abd-8903-427e-bf6f-d8d00b327bab service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:37.934975 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-03664ac6-3154-4662-b61b-3cc0e2cc724c req-e1d78abd-8903-427e-bf6f-d8d00b327bab service nova] Creating event network-vif-deleted:0486dca9-9f57-4bbf-b5a9-72b4e774aea0 for instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 on hv-cinder-84327 Jun 22 10:30:37.948228 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-03664ac6-3154-4662-b61b-3cc0e2cc724c req-e1d78abd-8903-427e-bf6f-d8d00b327bab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066945 Jun 22 10:30:37.951004 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 541/1100] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:38.558895 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ab676ba2-fcac-41bf-948d-ea616464a558 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:38.559493 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ab676ba2-fcac-41bf-948d-ea616464a558 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:38.566009 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab676ba2-fcac-41bf-948d-ea616464a558 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:38.566483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab676ba2-fcac-41bf-948d-ea616464a558 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:38.567947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab676ba2-fcac-41bf-948d-ea616464a558 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:38.569054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ab676ba2-fcac-41bf-948d-ea616464a558 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:38.651257 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ab676ba2-fcac-41bf-948d-ea616464a558 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:38.662245 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ab676ba2-fcac-41bf-948d-ea616464a558 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 200 len: 1326 microversion: 2.1 time: 0.108438 Jun 22 10:30:38.663462 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 560/1101] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:38 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 1326 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:39.680781 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e2bc90a0-84e4-4f9d-aafb-7e0378a3ffbb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:39.681512 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e2bc90a0-84e4-4f9d-aafb-7e0378a3ffbb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:39.688574 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e2bc90a0-84e4-4f9d-aafb-7e0378a3ffbb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:39.689088 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e2bc90a0-84e4-4f9d-aafb-7e0378a3ffbb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:39.689885 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e2bc90a0-84e4-4f9d-aafb-7e0378a3ffbb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:39.690310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e2bc90a0-84e4-4f9d-aafb-7e0378a3ffbb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:39.706746 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-e2bc90a0-84e4-4f9d-aafb-7e0378a3ffbb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e2bc90a0-84e4-4f9d-aafb-7e0378a3ffbb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 HTTP/1.1 Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:30:39.708408 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:30:39.710140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:30:39.710140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:30:39.710140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:30:39.710140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:30:39.710140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:30:39.710140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:30:39.710140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:30:39.710140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:30:39.710140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:30:39.710140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:30:39.710140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:30:39.710140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '95e62bb2-0dfd-4516-a97a-68aa18a98fe6'} Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:30:39.711003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:30:39.717428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:30:39.719060 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e2bc90a0-84e4-4f9d-aafb-7e0378a3ffbb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 404 to user: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:30:39.719060 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e2bc90a0-84e4-4f9d-aafb-7e0378a3ffbb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 404 len: 111 microversion: 2.1 time: 0.034172 Jun 22 10:30:39.719060 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 542/1102] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:39 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:30:39.719357 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-932989b7-30d0-4c1f-a10d-09d50448d6ad tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '.version_select at 0x7f021fdb93a0>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:39.834829 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-932989b7-30d0-4c1f-a10d-09d50448d6ad tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-428846125" status: 202 len: 0 microversion: 2.1 time: 0.119693 Jun 22 10:30:39.835414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 561/1103] 10.222.0.46 () {58 vars in 1217 bytes} [Wed Jun 22 10:30:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-428846125 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:30:40.654266 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-01ff9839-46ec-46f6-a3fe-5f870159d692 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: .version_select at 0x7f021fdc61f0>, body: {"keypair": {"name": "tempest-keypair-107258870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFAitHR3YRnXnTAIATilR47LXJ0xH7Jp9IkfGZneVDRU0lNIDUHxxUFOe7rpXSVourGqTpp6MVVbaPZcbc5ACi6LqihLGVzfxRbvEi8xcij9dP0ksdrAj2UMUvyDumoSg=="}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:40.668595 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-01ff9839-46ec-46f6-a3fe-5f870159d692 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for project 347c4ccbcb464091b8254475babf2874. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:30:40.672789 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-01ff9839-46ec-46f6-a3fe-5f870159d692 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for user 082ece6ea4244242a6ba99152572c80f and project 347c4ccbcb464091b8254475babf2874. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:30:40.858701 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-01ff9839-46ec-46f6-a3fe-5f870159d692 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.209630 Jun 22 10:30:40.866801 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 543/1104] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jun 22 10:30:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:43.495597 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-674955567", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50c0d4d4-6a37-4a0f-93d4-ead4b389795a"}], "security_groups": [{"name": "tempest-securitygroup--2042279915"}], "key_name": "tempest-keypair-107258870", "user_data": "}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:43.606251 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.network.neutron [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] validate_networks() for [('50c0d4d4-6a37-4a0f-93d4-ead4b389795a', None, None, None, None, None)] {{(pid=118327) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:30:44.242151 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Flavor limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:30:44.242576 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Image limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:30:44.243046 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Flavor pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:30:44.243453 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Image pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:30:44.243863 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:30:44.254172 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:44.254953 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:44.255423 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:44.255889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:44.272868 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for project 347c4ccbcb464091b8254475babf2874. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:30:44.277128 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for user 082ece6ea4244242a6ba99152572c80f and project 347c4ccbcb464091b8254475babf2874. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:30:44.289190 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Going to run 1 instances... {{(pid=118327) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:30:44.291481 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:30:44.443240 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-60d7c890-83d2-44c7-b946-d0bfa811f76d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.952702 Jun 22 10:30:44.444116 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 562/1105] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:30:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:30:44.454491 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-276a7099-9960-4a98-96e5-a3b1a756b669 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:44.455304 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-276a7099-9960-4a98-96e5-a3b1a756b669 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:44.516183 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-276a7099-9960-4a98-96e5-a3b1a756b669 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:44.524913 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-276a7099-9960-4a98-96e5-a3b1a756b669 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1240 microversion: 2.1 time: 0.074866 Jun 22 10:30:44.525487 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 544/1106] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:44 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:45.542669 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f7c2c3dd-82c9-4a95-95b4-dc999bb6ce39 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:45.543323 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f7c2c3dd-82c9-4a95-95b4-dc999bb6ce39 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:45.605521 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f7c2c3dd-82c9-4a95-95b4-dc999bb6ce39 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:45.613409 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f7c2c3dd-82c9-4a95-95b4-dc999bb6ce39 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1240 microversion: 2.1 time: 0.074625 Jun 22 10:30:45.622820 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 563/1107] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:45 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:46.631054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9be2ec9d-3320-430d-be58-0d889937d2db tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:46.631673 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9be2ec9d-3320-430d-be58-0d889937d2db tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:46.638739 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9be2ec9d-3320-430d-be58-0d889937d2db tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:46.639191 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9be2ec9d-3320-430d-be58-0d889937d2db tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:46.639958 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9be2ec9d-3320-430d-be58-0d889937d2db tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:46.640400 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9be2ec9d-3320-430d-be58-0d889937d2db tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:46.702877 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9be2ec9d-3320-430d-be58-0d889937d2db tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:46.710320 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9be2ec9d-3320-430d-be58-0d889937d2db tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1292 microversion: 2.1 time: 0.083138 Jun 22 10:30:46.713860 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 545/1108] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:46 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:47.727568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ba7d102e-49ca-4589-9ae1-ac5d85509f08 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:47.728103 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ba7d102e-49ca-4589-9ae1-ac5d85509f08 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:47.734892 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ba7d102e-49ca-4589-9ae1-ac5d85509f08 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:47.735348 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ba7d102e-49ca-4589-9ae1-ac5d85509f08 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:47.736123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ba7d102e-49ca-4589-9ae1-ac5d85509f08 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:47.736566 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ba7d102e-49ca-4589-9ae1-ac5d85509f08 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:47.804541 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ba7d102e-49ca-4589-9ae1-ac5d85509f08 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:47.808291 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ba7d102e-49ca-4589-9ae1-ac5d85509f08 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1298 microversion: 2.1 time: 0.084662 Jun 22 10:30:47.809661 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 564/1109] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:47 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:48.825362 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-77918a66-2e18-49f5-aa53-fcda2a967659 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:48.826026 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-77918a66-2e18-49f5-aa53-fcda2a967659 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:48.832336 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77918a66-2e18-49f5-aa53-fcda2a967659 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:48.834241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77918a66-2e18-49f5-aa53-fcda2a967659 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:48.834241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77918a66-2e18-49f5-aa53-fcda2a967659 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:48.834241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77918a66-2e18-49f5-aa53-fcda2a967659 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:49.058487 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-77918a66-2e18-49f5-aa53-fcda2a967659 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:49.067564 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-77918a66-2e18-49f5-aa53-fcda2a967659 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1366 microversion: 2.1 time: 0.246073 Jun 22 10:30:49.068140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 546/1110] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:48 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:49.329960 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-9aad3004-42f8-4cff-992c-236a7b46256c req-657a028d-c253-4ce1-807b-dcbad2a8a7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c28ffa-560d-4223-b5b1-a78ebd83201f", "tag": "ea83d8f8-1c9f-4539-9896-f158ce55ca4b"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:49.345033 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-9aad3004-42f8-4cff-992c-236a7b46256c req-657a028d-c253-4ce1-807b-dcbad2a8a7b8 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:49.345543 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-9aad3004-42f8-4cff-992c-236a7b46256c req-657a028d-c253-4ce1-807b-dcbad2a8a7b8 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:49.358052 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-9aad3004-42f8-4cff-992c-236a7b46256c req-657a028d-c253-4ce1-807b-dcbad2a8a7b8 service nova] Creating event network-changed:ea83d8f8-1c9f-4539-9896-f158ce55ca4b for instance 38c28ffa-560d-4223-b5b1-a78ebd83201f on hv-cinder-84327 Jun 22 10:30:49.363444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-9aad3004-42f8-4cff-992c-236a7b46256c req-657a028d-c253-4ce1-807b-dcbad2a8a7b8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039520 Jun 22 10:30:49.364048 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 565/1111] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:50.084054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-19dfe7ee-9e57-4d5b-8f26-417a5a4ee91c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:50.084673 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-19dfe7ee-9e57-4d5b-8f26-417a5a4ee91c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:50.092115 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-19dfe7ee-9e57-4d5b-8f26-417a5a4ee91c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:50.092797 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-19dfe7ee-9e57-4d5b-8f26-417a5a4ee91c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:50.093610 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-19dfe7ee-9e57-4d5b-8f26-417a5a4ee91c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:50.094054 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-19dfe7ee-9e57-4d5b-8f26-417a5a4ee91c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:50.112716 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:50.231671 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-19dfe7ee-9e57-4d5b-8f26-417a5a4ee91c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:50.239229 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-19dfe7ee-9e57-4d5b-8f26-417a5a4ee91c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1366 microversion: 2.1 time: 0.159226 Jun 22 10:30:50.239801 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 547/1112] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:50 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:51.256412 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-68b93bfe-3f6b-4953-937a-a3cc4bab13a9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:51.257169 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-68b93bfe-3f6b-4953-937a-a3cc4bab13a9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:51.263528 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-68b93bfe-3f6b-4953-937a-a3cc4bab13a9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:51.263985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-68b93bfe-3f6b-4953-937a-a3cc4bab13a9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:51.264762 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-68b93bfe-3f6b-4953-937a-a3cc4bab13a9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:51.265224 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-68b93bfe-3f6b-4953-937a-a3cc4bab13a9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:51.398813 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-68b93bfe-3f6b-4953-937a-a3cc4bab13a9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:51.407345 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-68b93bfe-3f6b-4953-937a-a3cc4bab13a9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1366 microversion: 2.1 time: 0.155549 Jun 22 10:30:51.407932 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 566/1113] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:51 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:52.425310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-185b52b6-2334-47f9-93b3-6ae1a315cb89 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:52.426154 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-185b52b6-2334-47f9-93b3-6ae1a315cb89 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:52.429672 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:52.433757 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-185b52b6-2334-47f9-93b3-6ae1a315cb89 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:52.436434 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-185b52b6-2334-47f9-93b3-6ae1a315cb89 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:52.436434 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-185b52b6-2334-47f9-93b3-6ae1a315cb89 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:52.436434 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-185b52b6-2334-47f9-93b3-6ae1a315cb89 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:52.570931 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-185b52b6-2334-47f9-93b3-6ae1a315cb89 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:52.578706 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-185b52b6-2334-47f9-93b3-6ae1a315cb89 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1366 microversion: 2.1 time: 0.157327 Jun 22 10:30:52.579743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 548/1114] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:52 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:53.596123 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1a7ec31d-90f2-49f4-ae84-3154a8d2175d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:53.596665 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1a7ec31d-90f2-49f4-ae84-3154a8d2175d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:53.603922 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1a7ec31d-90f2-49f4-ae84-3154a8d2175d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:53.604372 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1a7ec31d-90f2-49f4-ae84-3154a8d2175d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:53.605178 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1a7ec31d-90f2-49f4-ae84-3154a8d2175d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:53.605623 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1a7ec31d-90f2-49f4-ae84-3154a8d2175d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:53.609360 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=85 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:53.743475 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1a7ec31d-90f2-49f4-ae84-3154a8d2175d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:53.751207 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1a7ec31d-90f2-49f4-ae84-3154a8d2175d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1366 microversion: 2.1 time: 0.159065 Jun 22 10:30:53.751774 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 567/1115] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:53 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:54.768547 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-10304551-e2cf-421d-b8e2-13bfe988a469 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:54.769388 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-10304551-e2cf-421d-b8e2-13bfe988a469 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:54.771903 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=6 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:54.777077 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-10304551-e2cf-421d-b8e2-13bfe988a469 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:54.777531 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-10304551-e2cf-421d-b8e2-13bfe988a469 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:54.778908 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-10304551-e2cf-421d-b8e2-13bfe988a469 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:54.779347 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-10304551-e2cf-421d-b8e2-13bfe988a469 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:54.913352 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-10304551-e2cf-421d-b8e2-13bfe988a469 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:54.920745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-10304551-e2cf-421d-b8e2-13bfe988a469 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1366 microversion: 2.1 time: 0.156587 Jun 22 10:30:54.921567 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 549/1116] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:54 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:55.937667 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cd63c038-52a9-4c2b-9617-c7cdff6fc786 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:55.938280 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-cd63c038-52a9-4c2b-9617-c7cdff6fc786 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:55.940175 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:55.941395 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=8 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:55.942030 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:55.947176 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cd63c038-52a9-4c2b-9617-c7cdff6fc786 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:55.953045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cd63c038-52a9-4c2b-9617-c7cdff6fc786 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:55.953045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cd63c038-52a9-4c2b-9617-c7cdff6fc786 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:55.953045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cd63c038-52a9-4c2b-9617-c7cdff6fc786 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:56.088631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cd63c038-52a9-4c2b-9617-c7cdff6fc786 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:56.097836 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cd63c038-52a9-4c2b-9617-c7cdff6fc786 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1366 microversion: 2.1 time: 0.162861 Jun 22 10:30:56.106527 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 568/1117] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:55 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:56.342832 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-2ae19b7b-f681-46ec-a409-664fd378c88a req-1589320d-ec2e-466f-950a-1d9334b02480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c28ffa-560d-4223-b5b1-a78ebd83201f", "name": "network-vif-plugged", "status": "completed", "tag": "ea83d8f8-1c9f-4539-9896-f158ce55ca4b"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:56.351719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-2ae19b7b-f681-46ec-a409-664fd378c88a req-1589320d-ec2e-466f-950a-1d9334b02480 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:56.352157 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-2ae19b7b-f681-46ec-a409-664fd378c88a req-1589320d-ec2e-466f-950a-1d9334b02480 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:56.363942 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-2ae19b7b-f681-46ec-a409-664fd378c88a req-1589320d-ec2e-466f-950a-1d9334b02480 service nova] Creating event network-vif-plugged:ea83d8f8-1c9f-4539-9896-f158ce55ca4b for instance 38c28ffa-560d-4223-b5b1-a78ebd83201f on hv-cinder-84327 Jun 22 10:30:56.368886 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-2ae19b7b-f681-46ec-a409-664fd378c88a req-1589320d-ec2e-466f-950a-1d9334b02480 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167469 Jun 22 10:30:56.369472 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 550/1118] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:57.114449 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8b683be5-d6c0-405b-8775-5ef298357edb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:57.115007 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8b683be5-d6c0-405b-8775-5ef298357edb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:57.123192 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8b683be5-d6c0-405b-8775-5ef298357edb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:57.123647 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8b683be5-d6c0-405b-8775-5ef298357edb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:57.124418 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8b683be5-d6c0-405b-8775-5ef298357edb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:57.124880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8b683be5-d6c0-405b-8775-5ef298357edb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:57.262501 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8b683be5-d6c0-405b-8775-5ef298357edb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:57.270700 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-8b683be5-d6c0-405b-8775-5ef298357edb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1366 microversion: 2.1 time: 0.161177 Jun 22 10:30:57.271274 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 569/1119] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:57 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:58.292440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-08b20ff6-f2be-4aef-8c61-6123b2484cae tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:58.293350 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-08b20ff6-f2be-4aef-8c61-6123b2484cae tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:58.305299 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-08b20ff6-f2be-4aef-8c61-6123b2484cae tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:58.306132 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-08b20ff6-f2be-4aef-8c61-6123b2484cae tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:58.307619 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-08b20ff6-f2be-4aef-8c61-6123b2484cae tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:58.308583 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-08b20ff6-f2be-4aef-8c61-6123b2484cae tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:58.461961 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-08b20ff6-f2be-4aef-8c61-6123b2484cae tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:58.471334 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-08b20ff6-f2be-4aef-8c61-6123b2484cae tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1366 microversion: 2.1 time: 0.187315 Jun 22 10:30:58.471922 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 551/1120] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:58 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:59.489461 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-24df5919-5c09-401c-a6b2-477deffb4e62 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:59.490078 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-24df5919-5c09-401c-a6b2-477deffb4e62 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:59.496734 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-24df5919-5c09-401c-a6b2-477deffb4e62 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:59.497218 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-24df5919-5c09-401c-a6b2-477deffb4e62 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:59.497991 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-24df5919-5c09-401c-a6b2-477deffb4e62 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:59.498430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-24df5919-5c09-401c-a6b2-477deffb4e62 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:59.632706 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-24df5919-5c09-401c-a6b2-477deffb4e62 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:59.640851 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-24df5919-5c09-401c-a6b2-477deffb4e62 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1556 microversion: 2.1 time: 0.155899 Jun 22 10:30:59.641421 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 570/1121] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:59 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:59.657640 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-17eb4476-c4b1-440a-b3cb-b018ac3b232c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:59.658163 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-17eb4476-c4b1-440a-b3cb-b018ac3b232c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:59.665081 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-17eb4476-c4b1-440a-b3cb-b018ac3b232c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:59.665538 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-17eb4476-c4b1-440a-b3cb-b018ac3b232c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:59.666376 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-17eb4476-c4b1-440a-b3cb-b018ac3b232c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:59.666751 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-17eb4476-c4b1-440a-b3cb-b018ac3b232c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:59.744617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-17eb4476-c4b1-440a-b3cb-b018ac3b232c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091585 Jun 22 10:30:59.745295 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 552/1122] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jun 22 10:30:59 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:31:00.802833 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-4a465063-f56c-4611-b2e2-180eb8031244 req-d68c54f5-93a8-4ec1-82fa-09af9757aabe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c28ffa-560d-4223-b5b1-a78ebd83201f", "tag": "ea83d8f8-1c9f-4539-9896-f158ce55ca4b"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:00.814216 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-4a465063-f56c-4611-b2e2-180eb8031244 req-d68c54f5-93a8-4ec1-82fa-09af9757aabe service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:00.814756 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-4a465063-f56c-4611-b2e2-180eb8031244 req-d68c54f5-93a8-4ec1-82fa-09af9757aabe service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:00.826403 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-4a465063-f56c-4611-b2e2-180eb8031244 req-d68c54f5-93a8-4ec1-82fa-09af9757aabe service nova] Creating event network-changed:ea83d8f8-1c9f-4539-9896-f158ce55ca4b for instance 38c28ffa-560d-4223-b5b1-a78ebd83201f on hv-cinder-84327 Jun 22 10:31:00.831876 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-4a465063-f56c-4611-b2e2-180eb8031244 req-d68c54f5-93a8-4ec1-82fa-09af9757aabe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033091 Jun 22 10:31:00.832495 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 571/1123] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:01.024588 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2062403326", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "networks": [{"uuid": "e7fd8560-97f0-45c7-a756-6113100113cb"}]}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:01.081751 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.network.neutron [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] validate_networks() for [('e7fd8560-97f0-45c7-a756-6113100113cb', None, None, None, None, None)] {{(pid=118326) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:31:01.961006 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Flavor limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:31:01.961470 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Image limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:31:01.961948 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Flavor pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:31:01.962360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Image pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:31:01.962773 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:31:01.972544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:01.973034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:01.973917 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:01.974337 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:01.995286 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Getting quotas for project 4ec35c44695245b2ab61de1996ceb0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:31:02.001732 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Getting quotas for user 50ad963ccc5b4504a0e5bc7751fc76cf and project 4ec35c44695245b2ab61de1996ceb0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:31:02.015220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Going to run 1 instances... {{(pid=118326) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:31:02.018962 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118326) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:31:02.162935 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7857a785-bd76-4350-88f5-26e6dd4352f8 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143010 Jun 22 10:31:02.163878 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 553/1124] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:31:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:31:02.175522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-526a810d-cf43-4ce4-8572-03f6b4c066bf tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:02.176267 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-526a810d-cf43-4ce4-8572-03f6b4c066bf tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:02.230457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-526a810d-cf43-4ce4-8572-03f6b4c066bf tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:02.237432 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-526a810d-cf43-4ce4-8572-03f6b4c066bf tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1219 microversion: 2.1 time: 0.067167 Jun 22 10:31:02.238229 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 572/1125] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:02 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:03.254674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-abe5bc1c-c716-4671-8cc9-3cf930c30c7f tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:03.255300 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-abe5bc1c-c716-4671-8cc9-3cf930c30c7f tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:03.308477 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-abe5bc1c-c716-4671-8cc9-3cf930c30c7f tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:03.316690 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-abe5bc1c-c716-4671-8cc9-3cf930c30c7f tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1219 microversion: 2.1 time: 0.066085 Jun 22 10:31:03.323700 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 554/1126] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:03 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:04.334441 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-629edc38-1213-4d13-8711-27953431076c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:04.335085 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-629edc38-1213-4d13-8711-27953431076c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:04.343401 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-629edc38-1213-4d13-8711-27953431076c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:04.346820 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-629edc38-1213-4d13-8711-27953431076c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:04.346820 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-629edc38-1213-4d13-8711-27953431076c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:04.346820 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-629edc38-1213-4d13-8711-27953431076c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:04.408283 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-629edc38-1213-4d13-8711-27953431076c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:04.415933 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-629edc38-1213-4d13-8711-27953431076c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1271 microversion: 2.1 time: 0.085547 Jun 22 10:31:04.416502 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 573/1127] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:04 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:05.432788 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-86e0bcc3-3738-4770-b12e-4aa61df5406e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:05.433438 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-86e0bcc3-3738-4770-b12e-4aa61df5406e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:05.444753 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-86e0bcc3-3738-4770-b12e-4aa61df5406e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:05.444753 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-86e0bcc3-3738-4770-b12e-4aa61df5406e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:05.444753 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-86e0bcc3-3738-4770-b12e-4aa61df5406e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:05.444753 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-86e0bcc3-3738-4770-b12e-4aa61df5406e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:05.502338 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-86e0bcc3-3738-4770-b12e-4aa61df5406e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:05.509701 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-86e0bcc3-3738-4770-b12e-4aa61df5406e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1277 microversion: 2.1 time: 0.080796 Jun 22 10:31:05.510257 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 555/1128] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:05 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1277 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:06.526807 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-dddbfaf0-2a9b-41b1-b03e-e7398fac3537 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:06.527433 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-dddbfaf0-2a9b-41b1-b03e-e7398fac3537 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:06.535492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dddbfaf0-2a9b-41b1-b03e-e7398fac3537 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:06.535957 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dddbfaf0-2a9b-41b1-b03e-e7398fac3537 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:06.536897 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dddbfaf0-2a9b-41b1-b03e-e7398fac3537 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:06.537334 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-dddbfaf0-2a9b-41b1-b03e-e7398fac3537 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:06.563850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-6cfa8bf2-8b3e-46df-93bd-d65f3f9c22ac req-914999c4-9286-43fc-b2b6-d07037daf2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a31ecd-3076-435a-9f31-e14ca6920752", "tag": "178b989e-ee30-4c04-9e93-ff65307e89dc"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:06.573042 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-6cfa8bf2-8b3e-46df-93bd-d65f3f9c22ac req-914999c4-9286-43fc-b2b6-d07037daf2f2 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:06.574570 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-6cfa8bf2-8b3e-46df-93bd-d65f3f9c22ac req-914999c4-9286-43fc-b2b6-d07037daf2f2 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:06.586300 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-6cfa8bf2-8b3e-46df-93bd-d65f3f9c22ac req-914999c4-9286-43fc-b2b6-d07037daf2f2 service nova] Creating event network-changed:178b989e-ee30-4c04-9e93-ff65307e89dc for instance b3a31ecd-3076-435a-9f31-e14ca6920752 on hv-cinder-84327 Jun 22 10:31:06.592245 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-6cfa8bf2-8b3e-46df-93bd-d65f3f9c22ac req-914999c4-9286-43fc-b2b6-d07037daf2f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034128 Jun 22 10:31:06.593213 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 556/1129] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:06.734782 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-dddbfaf0-2a9b-41b1-b03e-e7398fac3537 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:06.742737 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-dddbfaf0-2a9b-41b1-b03e-e7398fac3537 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1319 microversion: 2.1 time: 0.219829 Jun 22 10:31:06.743311 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 574/1130] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:06 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:07.775682 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-7189faa8-a349-4a45-9bf2-2a39baee2331 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:07.776386 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-7189faa8-a349-4a45-9bf2-2a39baee2331 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:07.783413 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7189faa8-a349-4a45-9bf2-2a39baee2331 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:07.783867 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7189faa8-a349-4a45-9bf2-2a39baee2331 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:07.784681 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7189faa8-a349-4a45-9bf2-2a39baee2331 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:07.785153 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-7189faa8-a349-4a45-9bf2-2a39baee2331 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:07.923947 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-7189faa8-a349-4a45-9bf2-2a39baee2331 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:07.931380 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-7189faa8-a349-4a45-9bf2-2a39baee2331 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1319 microversion: 2.1 time: 0.160379 Jun 22 10:31:07.931950 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 557/1131] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:07 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:08.947870 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a3bc392e-52b1-46c3-b16f-b0f6c0b7b8b6 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:08.948489 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a3bc392e-52b1-46c3-b16f-b0f6c0b7b8b6 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:08.955869 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a3bc392e-52b1-46c3-b16f-b0f6c0b7b8b6 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:08.960293 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a3bc392e-52b1-46c3-b16f-b0f6c0b7b8b6 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:08.960293 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a3bc392e-52b1-46c3-b16f-b0f6c0b7b8b6 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:08.960293 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a3bc392e-52b1-46c3-b16f-b0f6c0b7b8b6 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:09.095141 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a3bc392e-52b1-46c3-b16f-b0f6c0b7b8b6 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:09.102758 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a3bc392e-52b1-46c3-b16f-b0f6c0b7b8b6 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1319 microversion: 2.1 time: 0.158800 Jun 22 10:31:09.103324 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 575/1132] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:08 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:10.119734 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a2dac688-dab2-4d57-899d-b633b4cbc39e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:10.120350 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a2dac688-dab2-4d57-899d-b633b4cbc39e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:10.127163 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a2dac688-dab2-4d57-899d-b633b4cbc39e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:10.127627 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a2dac688-dab2-4d57-899d-b633b4cbc39e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:10.128402 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a2dac688-dab2-4d57-899d-b633b4cbc39e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:10.128871 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a2dac688-dab2-4d57-899d-b633b4cbc39e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:10.264349 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a2dac688-dab2-4d57-899d-b633b4cbc39e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:10.271896 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a2dac688-dab2-4d57-899d-b633b4cbc39e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1319 microversion: 2.1 time: 0.156141 Jun 22 10:31:10.272463 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 558/1133] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:10 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:11.289081 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b7ca34e9-4e2b-4d4e-aed2-ab8b3021018b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:11.289701 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b7ca34e9-4e2b-4d4e-aed2-ab8b3021018b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:11.297194 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b7ca34e9-4e2b-4d4e-aed2-ab8b3021018b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:11.297649 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b7ca34e9-4e2b-4d4e-aed2-ab8b3021018b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:11.298418 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b7ca34e9-4e2b-4d4e-aed2-ab8b3021018b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:11.298857 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b7ca34e9-4e2b-4d4e-aed2-ab8b3021018b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:11.427866 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b7ca34e9-4e2b-4d4e-aed2-ab8b3021018b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:11.435671 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b7ca34e9-4e2b-4d4e-aed2-ab8b3021018b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1319 microversion: 2.1 time: 0.150578 Jun 22 10:31:11.445909 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 576/1134] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:11 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:12.346785 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-b9f328c8-6297-47cb-89dc-9a6d84e14cd9 req-970224d7-e4a7-4601-8f25-f7130ff77ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a31ecd-3076-435a-9f31-e14ca6920752", "name": "network-vif-plugged", "status": "completed", "tag": "178b989e-ee30-4c04-9e93-ff65307e89dc"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:12.351328 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:12.356764 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-b9f328c8-6297-47cb-89dc-9a6d84e14cd9 req-970224d7-e4a7-4601-8f25-f7130ff77ff3 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:12.365826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-b9f328c8-6297-47cb-89dc-9a6d84e14cd9 req-970224d7-e4a7-4601-8f25-f7130ff77ff3 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:12.371112 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-b9f328c8-6297-47cb-89dc-9a6d84e14cd9 req-970224d7-e4a7-4601-8f25-f7130ff77ff3 service nova] Creating event network-vif-plugged:178b989e-ee30-4c04-9e93-ff65307e89dc for instance b3a31ecd-3076-435a-9f31-e14ca6920752 on hv-cinder-84327 Jun 22 10:31:12.376991 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-b9f328c8-6297-47cb-89dc-9a6d84e14cd9 req-970224d7-e4a7-4601-8f25-f7130ff77ff3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034357 Jun 22 10:31:12.377565 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 559/1135] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:31:12.451879 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6b1f286f-d664-44ed-9f78-e4ed18edf31b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:12.452740 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6b1f286f-d664-44ed-9f78-e4ed18edf31b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:12.454575 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:12.462520 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6b1f286f-d664-44ed-9f78-e4ed18edf31b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:12.462977 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6b1f286f-d664-44ed-9f78-e4ed18edf31b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:12.463761 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6b1f286f-d664-44ed-9f78-e4ed18edf31b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:12.464204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6b1f286f-d664-44ed-9f78-e4ed18edf31b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:12.595808 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6b1f286f-d664-44ed-9f78-e4ed18edf31b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:12.603354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6b1f286f-d664-44ed-9f78-e4ed18edf31b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1319 microversion: 2.1 time: 0.155420 Jun 22 10:31:12.610705 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 577/1136] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:12 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:13.621726 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-86b6c4e6-ea95-4282-a663-0a16447133f2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:13.622487 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-86b6c4e6-ea95-4282-a663-0a16447133f2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:13.624381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=8 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:13.630023 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-86b6c4e6-ea95-4282-a663-0a16447133f2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:13.630476 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-86b6c4e6-ea95-4282-a663-0a16447133f2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:13.631243 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-86b6c4e6-ea95-4282-a663-0a16447133f2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:13.631710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-86b6c4e6-ea95-4282-a663-0a16447133f2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:13.762912 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-86b6c4e6-ea95-4282-a663-0a16447133f2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:13.770321 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-86b6c4e6-ea95-4282-a663-0a16447133f2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1319 microversion: 2.1 time: 0.153400 Jun 22 10:31:13.770883 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 560/1137] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:13 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:14.788055 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ba17833f-e681-462f-8683-430b0517c16a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:14.788640 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ba17833f-e681-462f-8683-430b0517c16a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:14.795701 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ba17833f-e681-462f-8683-430b0517c16a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:14.796144 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ba17833f-e681-462f-8683-430b0517c16a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:14.796926 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ba17833f-e681-462f-8683-430b0517c16a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:14.797361 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ba17833f-e681-462f-8683-430b0517c16a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:14.930910 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ba17833f-e681-462f-8683-430b0517c16a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:14.938965 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ba17833f-e681-462f-8683-430b0517c16a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1319 microversion: 2.1 time: 0.155339 Jun 22 10:31:14.939583 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 578/1138] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:14 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:15.962682 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-20fa78f3-038d-4cf4-8421-bf8aa01121e4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:15.962682 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-20fa78f3-038d-4cf4-8421-bf8aa01121e4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:15.963954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-20fa78f3-038d-4cf4-8421-bf8aa01121e4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:15.964406 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-20fa78f3-038d-4cf4-8421-bf8aa01121e4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:15.965211 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-20fa78f3-038d-4cf4-8421-bf8aa01121e4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:15.965673 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-20fa78f3-038d-4cf4-8421-bf8aa01121e4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:16.097298 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-20fa78f3-038d-4cf4-8421-bf8aa01121e4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:16.106187 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-20fa78f3-038d-4cf4-8421-bf8aa01121e4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1509 microversion: 2.1 time: 0.153641 Jun 22 10:31:16.106987 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 561/1139] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:15 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:17.590917 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9b1a5359-0330-4d1e-a4d8-f4bb0069e2ac tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:17.591824 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9b1a5359-0330-4d1e-a4d8-f4bb0069e2ac tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:17.593605 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-fb5c7684-918f-48b6-85b5-7824996f53a4 req-931ecda9-a0cc-4dc0-9ff9-36f16613d630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78ebc75e-8531-4681-823f-01a293b4cdbb", "tag": "f2fcd12b-26c2-4da9-8312-532778fa247c"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:17.598965 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9b1a5359-0330-4d1e-a4d8-f4bb0069e2ac tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:17.599430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9b1a5359-0330-4d1e-a4d8-f4bb0069e2ac tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:17.600228 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9b1a5359-0330-4d1e-a4d8-f4bb0069e2ac tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:17.600907 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9b1a5359-0330-4d1e-a4d8-f4bb0069e2ac tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:17.602423 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-fb5c7684-918f-48b6-85b5-7824996f53a4 req-931ecda9-a0cc-4dc0-9ff9-36f16613d630 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:17.603157 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-fb5c7684-918f-48b6-85b5-7824996f53a4 req-931ecda9-a0cc-4dc0-9ff9-36f16613d630 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:17.624022 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-fb5c7684-918f-48b6-85b5-7824996f53a4 req-931ecda9-a0cc-4dc0-9ff9-36f16613d630 service nova] Creating event network-changed:f2fcd12b-26c2-4da9-8312-532778fa247c for instance 78ebc75e-8531-4681-823f-01a293b4cdbb on hv-cinder-84327 Jun 22 10:31:17.629417 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-fb5c7684-918f-48b6-85b5-7824996f53a4 req-931ecda9-a0cc-4dc0-9ff9-36f16613d630 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039694 Jun 22 10:31:17.630024 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 562/1140] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:17.630954 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9b1a5359-0330-4d1e-a4d8-f4bb0069e2ac tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Going to try to terminate instance {{(pid=118327) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:31:18.061519 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9b1a5359-0330-4d1e-a4d8-f4bb0069e2ac tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "DELETE /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 204 len: 0 microversion: 2.1 time: 0.474107 Jun 22 10:31:18.062308 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 579/1141] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:31:17 2022] DELETE /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:31:18.075100 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b7c6e4c1-a8c8-41cc-8d6f-8eea24fae88a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:18.075100 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b7c6e4c1-a8c8-41cc-8d6f-8eea24fae88a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:18.080909 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b7c6e4c1-a8c8-41cc-8d6f-8eea24fae88a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:18.081796 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b7c6e4c1-a8c8-41cc-8d6f-8eea24fae88a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:18.082760 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b7c6e4c1-a8c8-41cc-8d6f-8eea24fae88a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:18.083207 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b7c6e4c1-a8c8-41cc-8d6f-8eea24fae88a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:18.270958 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b7c6e4c1-a8c8-41cc-8d6f-8eea24fae88a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:18.279134 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b7c6e4c1-a8c8-41cc-8d6f-8eea24fae88a tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1577 microversion: 2.1 time: 0.211451 Jun 22 10:31:18.279790 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 563/1142] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:18 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:19.298261 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bc9ef190-51e2-4194-baaf-8654c2653dc1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:19.299042 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bc9ef190-51e2-4194-baaf-8654c2653dc1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:19.305646 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bc9ef190-51e2-4194-baaf-8654c2653dc1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:19.306101 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bc9ef190-51e2-4194-baaf-8654c2653dc1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:19.306875 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bc9ef190-51e2-4194-baaf-8654c2653dc1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:19.307321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bc9ef190-51e2-4194-baaf-8654c2653dc1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:19.723274 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bc9ef190-51e2-4194-baaf-8654c2653dc1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:19.731448 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bc9ef190-51e2-4194-baaf-8654c2653dc1 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1577 microversion: 2.1 time: 0.437451 Jun 22 10:31:19.732009 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 580/1143] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:19 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1577 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:20.751371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9130024f-734a-4d29-94f7-9d679834862e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:20.751984 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9130024f-734a-4d29-94f7-9d679834862e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:20.759457 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9130024f-734a-4d29-94f7-9d679834862e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:20.760956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9130024f-734a-4d29-94f7-9d679834862e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:20.762481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9130024f-734a-4d29-94f7-9d679834862e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:20.763017 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9130024f-734a-4d29-94f7-9d679834862e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:20.799877 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-98006a82-c534-4114-aca9-ef8d7db9017a req-a1b813a0-8a2f-4eaa-ab23-e11d45dfbe46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78ebc75e-8531-4681-823f-01a293b4cdbb", "name": "network-vif-deleted", "tag": "f2fcd12b-26c2-4da9-8312-532778fa247c"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:20.803379 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-98006a82-c534-4114-aca9-ef8d7db9017a req-a1b813a0-8a2f-4eaa-ab23-e11d45dfbe46 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:20.804010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-98006a82-c534-4114-aca9-ef8d7db9017a req-a1b813a0-8a2f-4eaa-ab23-e11d45dfbe46 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:20.815623 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-98006a82-c534-4114-aca9-ef8d7db9017a req-a1b813a0-8a2f-4eaa-ab23-e11d45dfbe46 service nova] Creating event network-vif-deleted:f2fcd12b-26c2-4da9-8312-532778fa247c for instance 78ebc75e-8531-4681-823f-01a293b4cdbb on hv-cinder-84327 Jun 22 10:31:20.820810 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-98006a82-c534-4114-aca9-ef8d7db9017a req-a1b813a0-8a2f-4eaa-ab23-e11d45dfbe46 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029895 Jun 22 10:31:20.821638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 581/1144] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:20.837260 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9130024f-734a-4d29-94f7-9d679834862e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:20.845538 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9130024f-734a-4d29-94f7-9d679834862e tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1390 microversion: 2.1 time: 0.100153 Jun 22 10:31:20.846107 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 564/1145] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:20 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1390 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:21.862770 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c839481e-3501-49b8-a5cf-c87af6a683bb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:21.863474 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c839481e-3501-49b8-a5cf-c87af6a683bb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:21.870744 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c839481e-3501-49b8-a5cf-c87af6a683bb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:21.871719 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c839481e-3501-49b8-a5cf-c87af6a683bb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:21.872581 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c839481e-3501-49b8-a5cf-c87af6a683bb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:21.873066 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c839481e-3501-49b8-a5cf-c87af6a683bb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:21.914230 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c839481e-3501-49b8-a5cf-c87af6a683bb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:21.914678 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c839481e-3501-49b8-a5cf-c87af6a683bb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:21.915128 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-c839481e-3501-49b8-a5cf-c87af6a683bb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lazy-loading 'fault' on Instance uuid 78ebc75e-8531-4681-823f-01a293b4cdbb {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:31:21.957218 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c839481e-3501-49b8-a5cf-c87af6a683bb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:21.964904 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c839481e-3501-49b8-a5cf-c87af6a683bb tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 200 len: 1229 microversion: 2.1 time: 0.106369 Jun 22 10:31:21.965498 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 582/1146] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:21 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 1229 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:22.982604 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c4e82d2e-bc31-4db8-8d6f-6b4f73b547a6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:22.983170 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c4e82d2e-bc31-4db8-8d6f-6b4f73b547a6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 78ebc75e-8531-4681-823f-01a293b4cdbb] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:22.991340 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c4e82d2e-bc31-4db8-8d6f-6b4f73b547a6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:22.991967 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c4e82d2e-bc31-4db8-8d6f-6b4f73b547a6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:22.993244 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c4e82d2e-bc31-4db8-8d6f-6b4f73b547a6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:22.993718 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c4e82d2e-bc31-4db8-8d6f-6b4f73b547a6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:22.996980 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=77 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:23.008948 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-c4e82d2e-bc31-4db8-8d6f-6b4f73b547a6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] HTTP exception thrown: Instance 78ebc75e-8531-4681-823f-01a293b4cdbb could not be found. Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c4e82d2e-bc31-4db8-8d6f-6b4f73b547a6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Request method failure captured: Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb HTTP/1.1 Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu1SXkTD99ntCW7FdlVONdMvVVwVQrqDZmj3a15AnY-hj_f-HmXLVtYjT7EASpWcDlruxNjxfkhIsVpDtaszBvFoPzKZNJ1gnyaMLWiCF7aO_qawYM7irc4hKjcY81If9b-z6WEZwH_H2sTieQwGG26qBmmSznj27TQ47CHtuFKZ23M Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: abd71b49f6d9403b8cea1fd9e7680ffb Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-TestVolumeBootPattern-66661210 Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:31:23.010633 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:31:23.012774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_abd71b49f6d9403b8cea1fd9e7680ffb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:31:23.012774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-TestVolumeBootPattern-66661210 Jun 22 10:31:23.012774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: abd71b49f6d9403b8cea1fd9e7680ffb Jun 22 10:31:23.012774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-TestVolumeBootPattern-66661210 Jun 22 10:31:23.012774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-TestVolumeBootPattern-66661210-project Jun 22 10:31:23.012774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:31:23.012774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:31:23.012774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 401fdd54d8a143a892fd2d2407a78bc5 Jun 22 10:31:23.012774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-TestVolumeBootPattern-66661210-project Jun 22 10:31:23.012774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:31:23.012774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 78ebc75e-8531-4681-823f-01a293b4cdbb could not be found. Jun 22 10:31:23.012774 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '78ebc75e-8531-4681-823f-01a293b4cdbb'} Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78ebc75e-8531-4681-823f-01a293b4cdbb could not be found. Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:31:23.021745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78ebc75e-8531-4681-823f-01a293b4cdbb could not be found. Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78ebc75e-8531-4681-823f-01a293b4cdbb could not be found. Jun 22 10:31:23.023811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:23.025029 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c4e82d2e-bc31-4db8-8d6f-6b4f73b547a6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Returning 404 to user: Instance 78ebc75e-8531-4681-823f-01a293b4cdbb could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:31:23.025029 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c4e82d2e-bc31-4db8-8d6f-6b4f73b547a6 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb" status: 404 len: 111 microversion: 2.1 time: 0.033515 Jun 22 10:31:23.025029 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 565/1147] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:22 2022] GET /compute/v2.1/servers/78ebc75e-8531-4681-823f-01a293b4cdbb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:31:26.592772 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e0c40028-0451-4a5a-9c59-da9c50874df8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:26.593672 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e0c40028-0451-4a5a-9c59-da9c50874df8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:26.594459 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-8435eb85-be9f-45de-8e11-3471ebc53c1b req-7383d241-d4cc-4997-a161-dabc4454e55c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f937aa71-eccb-46ec-881c-5ca18c2d6b22", "tag": "1a7bddf0-650f-4019-a4b1-988837b832ec"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:26.599055 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:26.600588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e0c40028-0451-4a5a-9c59-da9c50874df8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:26.601109 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e0c40028-0451-4a5a-9c59-da9c50874df8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:26.602086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e0c40028-0451-4a5a-9c59-da9c50874df8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:26.602521 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e0c40028-0451-4a5a-9c59-da9c50874df8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:26.605719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-8435eb85-be9f-45de-8e11-3471ebc53c1b req-7383d241-d4cc-4997-a161-dabc4454e55c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:26.606186 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-8435eb85-be9f-45de-8e11-3471ebc53c1b req-7383d241-d4cc-4997-a161-dabc4454e55c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:26.607733 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:26.621476 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-8435eb85-be9f-45de-8e11-3471ebc53c1b req-7383d241-d4cc-4997-a161-dabc4454e55c service nova] Creating event network-changed:1a7bddf0-650f-4019-a4b1-988837b832ec for instance f937aa71-eccb-46ec-881c-5ca18c2d6b22 on hv-cinder-84327 Jun 22 10:31:26.626889 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-8435eb85-be9f-45de-8e11-3471ebc53c1b req-7383d241-d4cc-4997-a161-dabc4454e55c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037158 Jun 22 10:31:26.632549 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 566/1148] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:26.633110 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e0c40028-0451-4a5a-9c59-da9c50874df8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Going to try to terminate instance {{(pid=118327) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:31:27.004167 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e0c40028-0451-4a5a-9c59-da9c50874df8 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 204 len: 0 microversion: 2.1 time: 0.416258 Jun 22 10:31:27.007982 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 583/1149] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:31:26 2022] DELETE /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:31:27.014634 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e639182c-bf4f-4c25-ba63-140f395931c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:27.015490 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e639182c-bf4f-4c25-ba63-140f395931c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:27.023480 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e639182c-bf4f-4c25-ba63-140f395931c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:27.024075 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e639182c-bf4f-4c25-ba63-140f395931c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:27.024954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e639182c-bf4f-4c25-ba63-140f395931c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:27.025403 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e639182c-bf4f-4c25-ba63-140f395931c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:27.167682 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e639182c-bf4f-4c25-ba63-140f395931c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:27.176384 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e639182c-bf4f-4c25-ba63-140f395931c0 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1578 microversion: 2.1 time: 0.166662 Jun 22 10:31:27.176994 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 567/1150] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:27 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:28.194003 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0b422924-b0ca-4bfe-a3d8-7180ea5f53c3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:28.194825 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0b422924-b0ca-4bfe-a3d8-7180ea5f53c3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:28.201855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b422924-b0ca-4bfe-a3d8-7180ea5f53c3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:28.202306 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b422924-b0ca-4bfe-a3d8-7180ea5f53c3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:28.203087 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b422924-b0ca-4bfe-a3d8-7180ea5f53c3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:28.203528 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0b422924-b0ca-4bfe-a3d8-7180ea5f53c3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:28.429715 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0b422924-b0ca-4bfe-a3d8-7180ea5f53c3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:28.438126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0b422924-b0ca-4bfe-a3d8-7180ea5f53c3 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1459 microversion: 2.1 time: 0.248688 Jun 22 10:31:28.438610 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 584/1151] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:28 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1459 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:31:28.816533 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-bf9243e5-bdd4-48fb-8627-0e799fb300d0 req-c9032ae5-0520-4f01-be82-714ba30c1ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f937aa71-eccb-46ec-881c-5ca18c2d6b22", "name": "network-vif-deleted", "tag": "1a7bddf0-650f-4019-a4b1-988837b832ec"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:28.825626 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-bf9243e5-bdd4-48fb-8627-0e799fb300d0 req-c9032ae5-0520-4f01-be82-714ba30c1ea7 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:28.825626 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-bf9243e5-bdd4-48fb-8627-0e799fb300d0 req-c9032ae5-0520-4f01-be82-714ba30c1ea7 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:28.837282 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-bf9243e5-bdd4-48fb-8627-0e799fb300d0 req-c9032ae5-0520-4f01-be82-714ba30c1ea7 service nova] Creating event network-vif-deleted:1a7bddf0-650f-4019-a4b1-988837b832ec for instance f937aa71-eccb-46ec-881c-5ca18c2d6b22 on hv-cinder-84327 Jun 22 10:31:28.842670 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-bf9243e5-bdd4-48fb-8627-0e799fb300d0 req-c9032ae5-0520-4f01-be82-714ba30c1ea7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029373 Jun 22 10:31:28.843457 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 568/1152] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:29.455827 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7c506925-8cfe-4b6e-8989-710c6f5d29db tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:29.456375 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7c506925-8cfe-4b6e-8989-710c6f5d29db tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:29.463126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7c506925-8cfe-4b6e-8989-710c6f5d29db tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:29.463570 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7c506925-8cfe-4b6e-8989-710c6f5d29db tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:29.464328 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7c506925-8cfe-4b6e-8989-710c6f5d29db tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:29.464770 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7c506925-8cfe-4b6e-8989-710c6f5d29db tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:29.532266 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7c506925-8cfe-4b6e-8989-710c6f5d29db tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '401fdd54d8a143a892fd2d2407a78bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd71b49f6d9403b8cea1fd9e7680ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:29.540239 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7c506925-8cfe-4b6e-8989-710c6f5d29db tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 200 len: 1224 microversion: 2.1 time: 0.088527 Jun 22 10:31:29.540830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 585/1153] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:29 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:30.565272 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bb4b8ee5-e145-4395-95df-b59b5282a5c2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:30.565947 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bb4b8ee5-e145-4395-95df-b59b5282a5c2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: f937aa71-eccb-46ec-881c-5ca18c2d6b22] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:30.572103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb4b8ee5-e145-4395-95df-b59b5282a5c2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:30.574297 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb4b8ee5-e145-4395-95df-b59b5282a5c2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:30.574297 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb4b8ee5-e145-4395-95df-b59b5282a5c2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:30.574297 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb4b8ee5-e145-4395-95df-b59b5282a5c2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:30.587755 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-bb4b8ee5-e145-4395-95df-b59b5282a5c2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] HTTP exception thrown: Instance f937aa71-eccb-46ec-881c-5ca18c2d6b22 could not be found. Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bb4b8ee5-e145-4395-95df-b59b5282a5c2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Request method failure captured: Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 HTTP/1.1 Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu1SXkTD99ntCW7FdlVONdMvVVwVQrqDZmj3a15AnY-hj_f-HmXLVtYjT7EASpWcDlruxNjxfkhIsVpDtaszBvFoPzKZNJ1gnyaMLWiCF7aO_qawYM7irc4hKjcY81If9b-z6WEZwH_H2sTieQwGG26qBmmSznj27TQ47CHtuFKZ23M Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: abd71b49f6d9403b8cea1fd9e7680ffb Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-TestVolumeBootPattern-66661210 Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:31:30.589440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:31:30.591076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_abd71b49f6d9403b8cea1fd9e7680ffb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:31:30.591076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-TestVolumeBootPattern-66661210 Jun 22 10:31:30.591076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: abd71b49f6d9403b8cea1fd9e7680ffb Jun 22 10:31:30.591076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-TestVolumeBootPattern-66661210 Jun 22 10:31:30.591076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-TestVolumeBootPattern-66661210-project Jun 22 10:31:30.591076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:31:30.591076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:31:30.591076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 401fdd54d8a143a892fd2d2407a78bc5 Jun 22 10:31:30.591076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-TestVolumeBootPattern-66661210-project Jun 22 10:31:30.591076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:31:30.591076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance f937aa71-eccb-46ec-881c-5ca18c2d6b22 could not be found. Jun 22 10:31:30.591076 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': 'f937aa71-eccb-46ec-881c-5ca18c2d6b22'} Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f937aa71-eccb-46ec-881c-5ca18c2d6b22 could not be found. Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:31:30.595702 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f937aa71-eccb-46ec-881c-5ca18c2d6b22 could not be found. Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f937aa71-eccb-46ec-881c-5ca18c2d6b22 could not be found. Jun 22 10:31:30.596979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:30.598490 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bb4b8ee5-e145-4395-95df-b59b5282a5c2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Returning 404 to user: Instance f937aa71-eccb-46ec-881c-5ca18c2d6b22 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:31:30.598490 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bb4b8ee5-e145-4395-95df-b59b5282a5c2 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22" status: 404 len: 111 microversion: 2.1 time: 0.030670 Jun 22 10:31:30.598490 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 569/1154] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:30 2022] GET /compute/v2.1/servers/f937aa71-eccb-46ec-881c-5ca18c2d6b22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:31:31.089451 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-66fe87e3-3f00-4c18-b08a-acdb3ae10d9c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:31.089966 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-66fe87e3-3f00-4c18-b08a-acdb3ae10d9c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:31.092390 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:31.097169 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-66fe87e3-3f00-4c18-b08a-acdb3ae10d9c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:31.097625 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-66fe87e3-3f00-4c18-b08a-acdb3ae10d9c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:31.098392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-66fe87e3-3f00-4c18-b08a-acdb3ae10d9c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:31.098830 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-66fe87e3-3f00-4c18-b08a-acdb3ae10d9c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:31.112690 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-66fe87e3-3f00-4c18-b08a-acdb3ae10d9c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] HTTP exception thrown: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-66fe87e3-3f00-4c18-b08a-acdb3ae10d9c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Request method failure captured: Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: DELETE /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 HTTP/1.1 Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu1SXkTD99ntCW7FdlVONdMvVVwVQrqDZmj3a15AnY-hj_f-HmXLVtYjT7EASpWcDlruxNjxfkhIsVpDtaszBvFoPzKZNJ1gnyaMLWiCF7aO_qawYM7irc4hKjcY81If9b-z6WEZwH_H2sTieQwGG26qBmmSznj27TQ47CHtuFKZ23M Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: abd71b49f6d9403b8cea1fd9e7680ffb Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-TestVolumeBootPattern-66661210 Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:31:31.114352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:31:31.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_abd71b49f6d9403b8cea1fd9e7680ffb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:31:31.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-TestVolumeBootPattern-66661210 Jun 22 10:31:31.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: abd71b49f6d9403b8cea1fd9e7680ffb Jun 22 10:31:31.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-TestVolumeBootPattern-66661210 Jun 22 10:31:31.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-TestVolumeBootPattern-66661210-project Jun 22 10:31:31.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:31:31.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:31:31.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 401fdd54d8a143a892fd2d2407a78bc5 Jun 22 10:31:31.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-TestVolumeBootPattern-66661210-project Jun 22 10:31:31.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:31:31.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:31:31.116054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '8da7b015-3aba-44c4-bcc3-3f90cb093d11'} Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:31:31.117086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:31:31.118321 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:31:31.119616 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-66fe87e3-3f00-4c18-b08a-acdb3ae10d9c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Returning 404 to user: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:31:31.119616 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-66fe87e3-3f00-4c18-b08a-acdb3ae10d9c tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 404 len: 111 microversion: 2.1 time: 0.030195 Jun 22 10:31:31.119616 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 586/1155] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:31:31 2022] DELETE /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:31:31.124990 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-78a00d38-698f-4b95-85f4-7d0c3144cf96 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:31.125601 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-78a00d38-698f-4b95-85f4-7d0c3144cf96 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] [instance: 8da7b015-3aba-44c4-bcc3-3f90cb093d11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:31.131703 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-78a00d38-698f-4b95-85f4-7d0c3144cf96 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:31.132153 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-78a00d38-698f-4b95-85f4-7d0c3144cf96 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:31.132956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-78a00d38-698f-4b95-85f4-7d0c3144cf96 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:31.133392 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-78a00d38-698f-4b95-85f4-7d0c3144cf96 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:31.147279 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-78a00d38-698f-4b95-85f4-7d0c3144cf96 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] HTTP exception thrown: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-78a00d38-698f-4b95-85f4-7d0c3144cf96 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Request method failure captured: Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 HTTP/1.1 Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu1SXkTD99ntCW7FdlVONdMvVVwVQrqDZmj3a15AnY-hj_f-HmXLVtYjT7EASpWcDlruxNjxfkhIsVpDtaszBvFoPzKZNJ1gnyaMLWiCF7aO_qawYM7irc4hKjcY81If9b-z6WEZwH_H2sTieQwGG26qBmmSznj27TQ47CHtuFKZ23M Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: abd71b49f6d9403b8cea1fd9e7680ffb Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-TestVolumeBootPattern-66661210 Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:31:31.148811 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:31:31.150482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_abd71b49f6d9403b8cea1fd9e7680ffb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/abd71b49f6d9403b8cea1fd9e7680ffb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:31:31.150482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-TestVolumeBootPattern-66661210 Jun 22 10:31:31.150482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: abd71b49f6d9403b8cea1fd9e7680ffb Jun 22 10:31:31.150482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-TestVolumeBootPattern-66661210 Jun 22 10:31:31.150482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-TestVolumeBootPattern-66661210-project Jun 22 10:31:31.150482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:31:31.150482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:31:31.150482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 401fdd54d8a143a892fd2d2407a78bc5 Jun 22 10:31:31.150482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-TestVolumeBootPattern-66661210-project Jun 22 10:31:31.150482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:31:31.150482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:31:31.150482 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '8da7b015-3aba-44c4-bcc3-3f90cb093d11'} Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:31:31.151401 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. Jun 22 10:31:31.153314 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:31:31.155050 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-78a00d38-698f-4b95-85f4-7d0c3144cf96 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Returning 404 to user: Instance 8da7b015-3aba-44c4-bcc3-3f90cb093d11 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:31:31.155050 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-78a00d38-698f-4b95-85f4-7d0c3144cf96 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11" status: 404 len: 111 microversion: 2.1 time: 0.029739 Jun 22 10:31:31.155050 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 570/1156] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:31 2022] GET /compute/v2.1/servers/8da7b015-3aba-44c4-bcc3-3f90cb093d11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:31:32.703845 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a2da7456-bcf9-42d3-83f6-323514ed10d9 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] Calling method '.version_select at 0x7f021ff0e940>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:32.785902 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a2da7456-bcf9-42d3-83f6-323514ed10d9 tempest-TestVolumeBootPattern-66661210 tempest-TestVolumeBootPattern-66661210-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-861565459" status: 202 len: 0 microversion: 2.1 time: 0.085956 Jun 22 10:31:32.786661 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 587/1157] 10.222.0.46 () {58 vars in 1259 bytes} [Wed Jun 22 10:31:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-861565459 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:31:39.054684 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4ab3b70e-a837-4154-b423-3ecf66349e1d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1579b883-3875-430c-b737-8de7d10f9fe4", "device": "/dev/sdb"}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:39.056235 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4ab3b70e-a837-4154-b423-3ecf66349e1d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:39.074212 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4ab3b70e-a837-4154-b423-3ecf66349e1d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:39.074212 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4ab3b70e-a837-4154-b423-3ecf66349e1d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:39.074212 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4ab3b70e-a837-4154-b423-3ecf66349e1d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:39.074212 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4ab3b70e-a837-4154-b423-3ecf66349e1d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:40.111488 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4ab3b70e-a837-4154-b423-3ecf66349e1d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "POST /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.057701 Jun 22 10:31:40.111488 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 571/1158] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:31:39 2022] POST /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752/os-volume_attachments => generated 194 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:09.042578 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:09.043337 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:09.047476 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0835ee70-5049-49c8-805c-6643c86dd2c2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:09.047964 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0835ee70-5049-49c8-805c-6643c86dd2c2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:09.054613 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0835ee70-5049-49c8-805c-6643c86dd2c2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:09.058907 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0835ee70-5049-49c8-805c-6643c86dd2c2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:09.058907 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0835ee70-5049-49c8-805c-6643c86dd2c2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:09.058907 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0835ee70-5049-49c8-805c-6643c86dd2c2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:09.137000 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-0835ee70-5049-49c8-805c-6643c86dd2c2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lazy-loading 'services' on Instance uuid b3a31ecd-3076-435a-9f31-e14ca6920752 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:32:09.402365 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0835ee70-5049-49c8-805c-6643c86dd2c2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752/os-volume_attachments/1579b883-3875-430c-b737-8de7d10f9fe4" status: 202 len: 0 microversion: 2.1 time: 0.360913 Jun 22 10:32:09.402961 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 588/1159] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jun 22 10:32:09 2022] DELETE /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752/os-volume_attachments/1579b883-3875-430c-b737-8de7d10f9fe4 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:32:10.515570 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=11 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:10.516348 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:10.520473 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4a5df247-1a6d-4cd5-b391-8892ca56261e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:10.521087 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4a5df247-1a6d-4cd5-b391-8892ca56261e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:10.527311 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4a5df247-1a6d-4cd5-b391-8892ca56261e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:10.527751 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4a5df247-1a6d-4cd5-b391-8892ca56261e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:10.528561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4a5df247-1a6d-4cd5-b391-8892ca56261e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:10.529025 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4a5df247-1a6d-4cd5-b391-8892ca56261e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:10.555512 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4a5df247-1a6d-4cd5-b391-8892ca56261e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:32:11.032504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4a5df247-1a6d-4cd5-b391-8892ca56261e tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 204 len: 0 microversion: 2.1 time: 0.517784 Jun 22 10:32:11.033066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 572/1160] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:32:10 2022] DELETE /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:32:11.042403 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-b2c7b1a6-74a3-4fe9-b1bd-decef2d4f59a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:11.043107 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-b2c7b1a6-74a3-4fe9-b1bd-decef2d4f59a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:11.049423 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b2c7b1a6-74a3-4fe9-b1bd-decef2d4f59a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:11.049877 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b2c7b1a6-74a3-4fe9-b1bd-decef2d4f59a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:11.050648 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b2c7b1a6-74a3-4fe9-b1bd-decef2d4f59a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:11.051088 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-b2c7b1a6-74a3-4fe9-b1bd-decef2d4f59a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:11.197719 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-b2c7b1a6-74a3-4fe9-b1bd-decef2d4f59a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:11.205761 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-b2c7b1a6-74a3-4fe9-b1bd-decef2d4f59a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1515 microversion: 2.1 time: 0.168021 Jun 22 10:32:11.206318 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 589/1161] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:11 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:12.223346 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9da01a50-5618-4f11-998e-0b1033a58ba4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:12.224066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9da01a50-5618-4f11-998e-0b1033a58ba4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:12.231842 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9da01a50-5618-4f11-998e-0b1033a58ba4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:12.236660 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9da01a50-5618-4f11-998e-0b1033a58ba4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:12.236660 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9da01a50-5618-4f11-998e-0b1033a58ba4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:12.236660 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9da01a50-5618-4f11-998e-0b1033a58ba4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:12.361142 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9da01a50-5618-4f11-998e-0b1033a58ba4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:12.368527 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9da01a50-5618-4f11-998e-0b1033a58ba4 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1515 microversion: 2.1 time: 0.149467 Jun 22 10:32:12.369113 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 573/1162] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:12 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:13.308188 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-64648a19-dcf5-4800-a9da-429d9b13ec99 req-b2db2688-ead5-4e4b-916c-3444f7989629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a31ecd-3076-435a-9f31-e14ca6920752", "name": "network-vif-deleted", "tag": "178b989e-ee30-4c04-9e93-ff65307e89dc"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:32:13.317719 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-64648a19-dcf5-4800-a9da-429d9b13ec99 req-b2db2688-ead5-4e4b-916c-3444f7989629 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:13.322449 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-64648a19-dcf5-4800-a9da-429d9b13ec99 req-b2db2688-ead5-4e4b-916c-3444f7989629 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:13.329044 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-64648a19-dcf5-4800-a9da-429d9b13ec99 req-b2db2688-ead5-4e4b-916c-3444f7989629 service nova] Creating event network-vif-deleted:178b989e-ee30-4c04-9e93-ff65307e89dc for instance b3a31ecd-3076-435a-9f31-e14ca6920752 on hv-cinder-84327 Jun 22 10:32:13.334130 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-64648a19-dcf5-4800-a9da-429d9b13ec99 req-b2db2688-ead5-4e4b-916c-3444f7989629 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029713 Jun 22 10:32:13.334718 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 590/1163] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:32:13.385530 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d7ef8bea-f84c-4d53-b911-e4e0f7e7d710 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:13.386320 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d7ef8bea-f84c-4d53-b911-e4e0f7e7d710 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:13.392936 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d7ef8bea-f84c-4d53-b911-e4e0f7e7d710 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:13.397123 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d7ef8bea-f84c-4d53-b911-e4e0f7e7d710 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:13.397123 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d7ef8bea-f84c-4d53-b911-e4e0f7e7d710 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:13.397123 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d7ef8bea-f84c-4d53-b911-e4e0f7e7d710 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:13.459573 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d7ef8bea-f84c-4d53-b911-e4e0f7e7d710 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:13.467562 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d7ef8bea-f84c-4d53-b911-e4e0f7e7d710 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 200 len: 1473 microversion: 2.1 time: 0.085963 Jun 22 10:32:13.468140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 574/1164] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:13 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 1473 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:14.484695 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4d1f3089-60e7-492b-8313-41ace87f9869 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:14.485412 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-4d1f3089-60e7-492b-8313-41ace87f9869 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: b3a31ecd-3076-435a-9f31-e14ca6920752] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:14.492035 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d1f3089-60e7-492b-8313-41ace87f9869 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:14.492485 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d1f3089-60e7-492b-8313-41ace87f9869 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:14.493304 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d1f3089-60e7-492b-8313-41ace87f9869 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:14.493743 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-4d1f3089-60e7-492b-8313-41ace87f9869 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:14.508266 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-4d1f3089-60e7-492b-8313-41ace87f9869 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] HTTP exception thrown: Instance b3a31ecd-3076-435a-9f31-e14ca6920752 could not be found. Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4d1f3089-60e7-492b-8313-41ace87f9869 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Request method failure captured: Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 HTTP/1.1 Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu9jhL0aa7M8eknfKDNy09CCMcpQLNY69aEIZvOivL92r-wdUX6VJdWFDU_m0qCiccgbqRQy0zvAzB4CPjfS0b8oJ7oVSRiiZRmFzRRTIEHjPUO-53lVuKepmrHBLD4XAscrWNLi5P_8xbwKrGLI8Cdj0LnCwq2DOqgdKOOi2MQE9Ag Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 4ec35c44695245b2ab61de1996ceb0ac Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-VolumesSnapshotTestJSON-624019428 Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:32:14.509955 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:32:14.511696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ec35c44695245b2ab61de1996ceb0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ec35c44695245b2ab61de1996ceb0ac", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ec35c44695245b2ab61de1996ceb0ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ec35c44695245b2ab61de1996ceb0ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:32:14.511696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-VolumesSnapshotTestJSON-624019428 Jun 22 10:32:14.511696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 4ec35c44695245b2ab61de1996ceb0ac Jun 22 10:32:14.511696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-624019428 Jun 22 10:32:14.511696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-VolumesSnapshotTestJSON-624019428-project Jun 22 10:32:14.511696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:32:14.511696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:32:14.511696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 50ad963ccc5b4504a0e5bc7751fc76cf Jun 22 10:32:14.511696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-VolumesSnapshotTestJSON-624019428-project Jun 22 10:32:14.511696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:32:14.511696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance b3a31ecd-3076-435a-9f31-e14ca6920752 could not be found. Jun 22 10:32:14.511696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': 'b3a31ecd-3076-435a-9f31-e14ca6920752'} Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a31ecd-3076-435a-9f31-e14ca6920752 could not be found. Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:14.512602 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a31ecd-3076-435a-9f31-e14ca6920752 could not be found. Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a31ecd-3076-435a-9f31-e14ca6920752 could not be found. Jun 22 10:32:14.514855 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:32:14.516193 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-4d1f3089-60e7-492b-8313-41ace87f9869 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Returning 404 to user: Instance b3a31ecd-3076-435a-9f31-e14ca6920752 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:14.516193 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-4d1f3089-60e7-492b-8313-41ace87f9869 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752" status: 404 len: 111 microversion: 2.1 time: 0.031562 Jun 22 10:32:14.516193 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 591/1165] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:14 2022] GET /compute/v2.1/servers/b3a31ecd-3076-435a-9f31-e14ca6920752 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:32:26.290755 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-619179598", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "networks": [{"uuid": "e7fd8560-97f0-45c7-a756-6113100113cb"}]}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:32:26.297927 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:26.298472 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:26.343963 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.network.neutron [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] validate_networks() for [('e7fd8560-97f0-45c7-a756-6113100113cb', None, None, None, None, None)] {{(pid=118326) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:32:26.698898 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Flavor limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:32:26.699323 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Image limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:32:26.699800 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Flavor pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:32:26.700212 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Image pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:32:26.700661 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:32:26.709632 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:26.710082 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:26.710883 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:26.711319 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:26.728923 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Getting quotas for project 4ec35c44695245b2ab61de1996ceb0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:32:26.732901 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Getting quotas for user 50ad963ccc5b4504a0e5bc7751fc76cf and project 4ec35c44695245b2ab61de1996ceb0ac. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:32:26.744308 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Going to run 1 instances... {{(pid=118326) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:32:26.746594 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118326) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:32:26.897880 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0decdedb-8b67-4d5f-acb4-90ab2d8cf844 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610924 Jun 22 10:32:26.898384 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 575/1166] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:32:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:32:26.906747 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=8 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:26.907542 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:26.911519 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f215e7e8-a821-4e5f-926c-5bc3bb0ede3c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:26.912135 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f215e7e8-a821-4e5f-926c-5bc3bb0ede3c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:26.966761 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f215e7e8-a821-4e5f-926c-5bc3bb0ede3c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:26.975255 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f215e7e8-a821-4e5f-926c-5bc3bb0ede3c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1218 microversion: 2.1 time: 0.070459 Jun 22 10:32:26.975832 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 592/1167] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:26 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:28.000933 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ac80c679-569f-4703-a1bf-29ee542cae6d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:28.001612 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ac80c679-569f-4703-a1bf-29ee542cae6d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:28.007850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ac80c679-569f-4703-a1bf-29ee542cae6d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:28.008338 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ac80c679-569f-4703-a1bf-29ee542cae6d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:28.009135 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ac80c679-569f-4703-a1bf-29ee542cae6d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:28.009577 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ac80c679-569f-4703-a1bf-29ee542cae6d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:28.071831 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ac80c679-569f-4703-a1bf-29ee542cae6d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:28.080364 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ac80c679-569f-4703-a1bf-29ee542cae6d tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1222 microversion: 2.1 time: 0.084554 Jun 22 10:32:28.080963 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 576/1168] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:27 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:29.098659 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-44c5ceea-5795-4ba7-a60e-0892e8c6e7b2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:29.099336 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-44c5ceea-5795-4ba7-a60e-0892e8c6e7b2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:29.106469 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-44c5ceea-5795-4ba7-a60e-0892e8c6e7b2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:29.106917 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-44c5ceea-5795-4ba7-a60e-0892e8c6e7b2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:29.107677 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-44c5ceea-5795-4ba7-a60e-0892e8c6e7b2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:29.108114 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-44c5ceea-5795-4ba7-a60e-0892e8c6e7b2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:29.185116 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-44c5ceea-5795-4ba7-a60e-0892e8c6e7b2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:29.192893 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-44c5ceea-5795-4ba7-a60e-0892e8c6e7b2 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1270 microversion: 2.1 time: 0.098752 Jun 22 10:32:29.193473 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 593/1169] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:29 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:30.210349 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-671d9ca3-b5ac-439e-a753-25de29d56d88 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:30.210971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-671d9ca3-b5ac-439e-a753-25de29d56d88 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:30.217979 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-671d9ca3-b5ac-439e-a753-25de29d56d88 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:30.218417 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-671d9ca3-b5ac-439e-a753-25de29d56d88 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:30.219188 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-671d9ca3-b5ac-439e-a753-25de29d56d88 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:30.220173 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-671d9ca3-b5ac-439e-a753-25de29d56d88 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:30.463471 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-671d9ca3-b5ac-439e-a753-25de29d56d88 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:30.471437 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-671d9ca3-b5ac-439e-a753-25de29d56d88 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1318 microversion: 2.1 time: 0.265066 Jun 22 10:32:30.472010 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 577/1170] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:30 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:32:31.095247 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-fe6d6c77-0162-41dd-b73a-144972f813b2 req-c77afd3c-ca8c-4fc4-81b8-7cab071f01a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ff1affd-58cc-4cff-89b3-6d45bf964537", "tag": "6d4c4563-2787-4037-bc84-4b103ec19051"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:32:31.104062 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-fe6d6c77-0162-41dd-b73a-144972f813b2 req-c77afd3c-ca8c-4fc4-81b8-7cab071f01a5 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:31.104544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-fe6d6c77-0162-41dd-b73a-144972f813b2 req-c77afd3c-ca8c-4fc4-81b8-7cab071f01a5 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:31.118228 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-fe6d6c77-0162-41dd-b73a-144972f813b2 req-c77afd3c-ca8c-4fc4-81b8-7cab071f01a5 service nova] Creating event network-changed:6d4c4563-2787-4037-bc84-4b103ec19051 for instance 2ff1affd-58cc-4cff-89b3-6d45bf964537 on hv-cinder-84327 Jun 22 10:32:31.123001 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-fe6d6c77-0162-41dd-b73a-144972f813b2 req-c77afd3c-ca8c-4fc4-81b8-7cab071f01a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032453 Jun 22 10:32:31.123688 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 594/1171] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:31.487462 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-01cd136a-d9c8-4465-808e-31be935ffb20 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:31.488074 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-01cd136a-d9c8-4465-808e-31be935ffb20 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:31.494610 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-01cd136a-d9c8-4465-808e-31be935ffb20 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:31.495055 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-01cd136a-d9c8-4465-808e-31be935ffb20 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:31.495815 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-01cd136a-d9c8-4465-808e-31be935ffb20 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:31.496247 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-01cd136a-d9c8-4465-808e-31be935ffb20 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:31.704427 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-01cd136a-d9c8-4465-808e-31be935ffb20 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:31.713876 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-01cd136a-d9c8-4465-808e-31be935ffb20 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1318 microversion: 2.1 time: 0.230163 Jun 22 10:32:31.714381 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 578/1172] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:31 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:32.732015 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-37606fe8-34ca-44d9-a13f-4cd75ea53a7b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:32.732706 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-37606fe8-34ca-44d9-a13f-4cd75ea53a7b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:32.739536 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-37606fe8-34ca-44d9-a13f-4cd75ea53a7b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:32.739981 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-37606fe8-34ca-44d9-a13f-4cd75ea53a7b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:32.740748 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-37606fe8-34ca-44d9-a13f-4cd75ea53a7b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:32.741202 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-37606fe8-34ca-44d9-a13f-4cd75ea53a7b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:32.869177 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-37606fe8-34ca-44d9-a13f-4cd75ea53a7b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:32.876527 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-37606fe8-34ca-44d9-a13f-4cd75ea53a7b tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1318 microversion: 2.1 time: 0.149204 Jun 22 10:32:32.877125 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 595/1173] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:32 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:32:33.893274 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-f4273139-858a-4a88-8f07-6481a73dfdb0 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:33.893885 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-f4273139-858a-4a88-8f07-6481a73dfdb0 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:33.900598 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f4273139-858a-4a88-8f07-6481a73dfdb0 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:33.901078 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f4273139-858a-4a88-8f07-6481a73dfdb0 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:33.901843 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f4273139-858a-4a88-8f07-6481a73dfdb0 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:33.902277 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-f4273139-858a-4a88-8f07-6481a73dfdb0 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:34.036138 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-f4273139-858a-4a88-8f07-6481a73dfdb0 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:34.043682 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-f4273139-858a-4a88-8f07-6481a73dfdb0 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1318 microversion: 2.1 time: 0.154845 Jun 22 10:32:34.044512 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 579/1174] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:33 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:35.062389 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2832322e-c233-4b4d-b722-2197f70ad328 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:35.063033 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2832322e-c233-4b4d-b722-2197f70ad328 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:35.069719 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2832322e-c233-4b4d-b722-2197f70ad328 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:35.070252 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2832322e-c233-4b4d-b722-2197f70ad328 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:35.071066 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2832322e-c233-4b4d-b722-2197f70ad328 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:35.071502 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2832322e-c233-4b4d-b722-2197f70ad328 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:35.201180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2832322e-c233-4b4d-b722-2197f70ad328 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:35.209070 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2832322e-c233-4b4d-b722-2197f70ad328 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1318 microversion: 2.1 time: 0.150518 Jun 22 10:32:35.209638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 596/1175] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:35 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:36.226391 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9b8435dc-a355-41be-bd08-9bab23c4fa56 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:36.226989 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9b8435dc-a355-41be-bd08-9bab23c4fa56 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:36.233649 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b8435dc-a355-41be-bd08-9bab23c4fa56 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:36.234104 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b8435dc-a355-41be-bd08-9bab23c4fa56 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:36.235518 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b8435dc-a355-41be-bd08-9bab23c4fa56 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:36.235960 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b8435dc-a355-41be-bd08-9bab23c4fa56 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:36.367555 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9b8435dc-a355-41be-bd08-9bab23c4fa56 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:36.374974 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9b8435dc-a355-41be-bd08-9bab23c4fa56 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1318 microversion: 2.1 time: 0.152519 Jun 22 10:32:36.376116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 580/1176] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:36 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:36.794835 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-87bb4a85-684c-4be7-94b2-21a6c1830d45 req-c5f5ab3c-4d6a-40a3-8646-a41c1fafadf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff1affd-58cc-4cff-89b3-6d45bf964537", "name": "network-vif-plugged", "status": "completed", "tag": "6d4c4563-2787-4037-bc84-4b103ec19051"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:32:36.802847 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-87bb4a85-684c-4be7-94b2-21a6c1830d45 req-c5f5ab3c-4d6a-40a3-8646-a41c1fafadf9 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:36.803294 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-87bb4a85-684c-4be7-94b2-21a6c1830d45 req-c5f5ab3c-4d6a-40a3-8646-a41c1fafadf9 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:36.814852 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-87bb4a85-684c-4be7-94b2-21a6c1830d45 req-c5f5ab3c-4d6a-40a3-8646-a41c1fafadf9 service nova] Creating event network-vif-plugged:6d4c4563-2787-4037-bc84-4b103ec19051 for instance 2ff1affd-58cc-4cff-89b3-6d45bf964537 on hv-cinder-84327 Jun 22 10:32:36.820922 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-87bb4a85-684c-4be7-94b2-21a6c1830d45 req-c5f5ab3c-4d6a-40a3-8646-a41c1fafadf9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030244 Jun 22 10:32:36.821696 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 597/1177] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:37.391603 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-fe7f75b9-bbdb-4a18-be61-c8dbdeba952a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:37.392339 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-fe7f75b9-bbdb-4a18-be61-c8dbdeba952a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:37.394390 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:37.399379 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=6 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:37.405604 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fe7f75b9-bbdb-4a18-be61-c8dbdeba952a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:37.406053 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fe7f75b9-bbdb-4a18-be61-c8dbdeba952a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:37.406835 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fe7f75b9-bbdb-4a18-be61-c8dbdeba952a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:37.407340 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fe7f75b9-bbdb-4a18-be61-c8dbdeba952a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:37.538743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-fe7f75b9-bbdb-4a18-be61-c8dbdeba952a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:37.546150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-fe7f75b9-bbdb-4a18-be61-c8dbdeba952a tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1318 microversion: 2.1 time: 0.158457 Jun 22 10:32:37.546714 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 581/1178] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:37 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:38.560073 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:38.564757 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-2b2764ce-0dbc-49ff-a948-3a063e0ce932 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:38.565484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-2b2764ce-0dbc-49ff-a948-3a063e0ce932 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:38.571765 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2b2764ce-0dbc-49ff-a948-3a063e0ce932 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:38.574624 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2b2764ce-0dbc-49ff-a948-3a063e0ce932 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:38.574624 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2b2764ce-0dbc-49ff-a948-3a063e0ce932 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:38.574624 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-2b2764ce-0dbc-49ff-a948-3a063e0ce932 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:38.705780 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-2b2764ce-0dbc-49ff-a948-3a063e0ce932 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:38.713124 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-2b2764ce-0dbc-49ff-a948-3a063e0ce932 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1318 microversion: 2.1 time: 0.153999 Jun 22 10:32:38.713682 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 598/1179] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:38 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:39.731198 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a08b9f3e-e46c-4cb7-8b81-930027d9d53c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:39.731716 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a08b9f3e-e46c-4cb7-8b81-930027d9d53c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:39.739203 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a08b9f3e-e46c-4cb7-8b81-930027d9d53c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:39.739629 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a08b9f3e-e46c-4cb7-8b81-930027d9d53c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:39.740390 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a08b9f3e-e46c-4cb7-8b81-930027d9d53c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:39.740838 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a08b9f3e-e46c-4cb7-8b81-930027d9d53c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:39.870107 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a08b9f3e-e46c-4cb7-8b81-930027d9d53c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:39.878218 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a08b9f3e-e46c-4cb7-8b81-930027d9d53c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1507 microversion: 2.1 time: 0.151835 Jun 22 10:32:39.878783 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 582/1180] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:39 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:39.894285 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d6220d9e-2aaa-4527-8d6d-86d2c063b0ca tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc5014cb-3fe7-4470-8d96-0466e4f67858", "device": "/dev/sdb"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:32:39.895832 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d6220d9e-2aaa-4527-8d6d-86d2c063b0ca tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:39.902507 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d6220d9e-2aaa-4527-8d6d-86d2c063b0ca tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:39.902951 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d6220d9e-2aaa-4527-8d6d-86d2c063b0ca tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:39.903727 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d6220d9e-2aaa-4527-8d6d-86d2c063b0ca tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:39.904155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d6220d9e-2aaa-4527-8d6d-86d2c063b0ca tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:40.834901 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d6220d9e-2aaa-4527-8d6d-86d2c063b0ca tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "POST /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.944343 Jun 22 10:32:40.835522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 599/1181] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:32:39 2022] POST /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537/os-volume_attachments => generated 194 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:43.246124 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5439473f-d455-406d-a02a-eb8cf8023996 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:43.246662 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5439473f-d455-406d-a02a-eb8cf8023996 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:43.253131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5439473f-d455-406d-a02a-eb8cf8023996 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:43.253570 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5439473f-d455-406d-a02a-eb8cf8023996 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:43.254318 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5439473f-d455-406d-a02a-eb8cf8023996 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:43.254750 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5439473f-d455-406d-a02a-eb8cf8023996 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:43.278033 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5439473f-d455-406d-a02a-eb8cf8023996 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/ips" status: 200 len: 150 microversion: 2.1 time: 0.224404 Jun 22 10:32:43.278575 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 583/1182] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jun 22 10:32:43 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/ips => generated 150 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:46.048497 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bc129c07-8b74-413a-9347-e67a8ff44b5a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e46c3227-0755-4338-a204-6c2a01957227"}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:32:46.049732 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bc129c07-8b74-413a-9347-e67a8ff44b5a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:46.056130 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bc129c07-8b74-413a-9347-e67a8ff44b5a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:46.056578 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bc129c07-8b74-413a-9347-e67a8ff44b5a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:46.057374 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bc129c07-8b74-413a-9347-e67a8ff44b5a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:46.057810 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bc129c07-8b74-413a-9347-e67a8ff44b5a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:46.814851 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bc129c07-8b74-413a-9347-e67a8ff44b5a tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.771528 Jun 22 10:32:46.815465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 600/1183] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:32:46 2022] POST /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments => generated 194 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:55.365896 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-83c4ee00-e787-4f9c-9d6c-33f569682ca7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e46c3227-0755-4338-a204-6c2a01957227"}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:32:55.369822 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-83c4ee00-e787-4f9c-9d6c-33f569682ca7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:55.369822 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:55.370161 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=48 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:55.374986 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-83c4ee00-e787-4f9c-9d6c-33f569682ca7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:55.375428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-83c4ee00-e787-4f9c-9d6c-33f569682ca7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:55.376206 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-83c4ee00-e787-4f9c-9d6c-33f569682ca7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:55.376645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-83c4ee00-e787-4f9c-9d6c-33f569682ca7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:55.458090 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-83c4ee00-e787-4f9c-9d6c-33f569682ca7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Invalid volume: volume e46c3227-0755-4338-a204-6c2a01957227 is already attached to instances: 38c28ffa-560d-4223-b5b1-a78ebd83201f Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-83c4ee00-e787-4f9c-9d6c-33f569682ca7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: POST /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments HTTP/1.1 Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 74 Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:32:55.459850 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:32:55.461688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:32:55.461688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:32:55.461688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:32:55.461688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:32:55.461688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:32:55.461688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:32:55.461688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:32:55.461688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:32:55.461688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:32:55.461688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Jun 22 10:32:55.461688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {"volumeAttachment": {"volumeId": "e46c3227-0755-4338-a204-6c2a01957227"}} Jun 22 10:32:55.461688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Invalid volume: volume e46c3227-0755-4338-a204-6c2a01957227 is already attached to instances: 38c28ffa-560d-4223-b5b1-a78ebd83201f Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'server_id': '38c28ffa-560d-4223-b5b1-a78ebd83201f', 'body': {'volumeAttachment': {'volumeId': 'e46c3227-0755-4338-a204-6c2a01957227'}}} Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e46c3227-0755-4338-a204-6c2a01957227 is already attached to instances: 38c28ffa-560d-4223-b5b1-a78ebd83201f Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:32:55.462621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e46c3227-0755-4338-a204-6c2a01957227 is already attached to instances: 38c28ffa-560d-4223-b5b1-a78ebd83201f Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:55.464103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:55.467673 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:55.467673 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:55.467673 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:55.467673 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e46c3227-0755-4338-a204-6c2a01957227 is already attached to instances: 38c28ffa-560d-4223-b5b1-a78ebd83201f Jun 22 10:32:55.467673 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:32:55.467673 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-83c4ee00-e787-4f9c-9d6c-33f569682ca7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 400 to user: Invalid volume: volume e46c3227-0755-4338-a204-6c2a01957227 is already attached to instances: 38c28ffa-560d-4223-b5b1-a78ebd83201f {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:55.467673 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-83c4ee00-e787-4f9c-9d6c-33f569682ca7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100129 Jun 22 10:32:55.467673 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 584/1184] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:32:55 2022] POST /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:32:55.522660 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-deb12a49-43f9-4e06-b964-0fa6db2040ee tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:55.523239 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-deb12a49-43f9-4e06-b964-0fa6db2040ee tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:55.529670 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-deb12a49-43f9-4e06-b964-0fa6db2040ee tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:55.530113 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-deb12a49-43f9-4e06-b964-0fa6db2040ee tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:55.530871 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-deb12a49-43f9-4e06-b964-0fa6db2040ee tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:55.531305 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-deb12a49-43f9-4e06-b964-0fa6db2040ee tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:55.613250 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-deb12a49-43f9-4e06-b964-0fa6db2040ee tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lazy-loading 'services' on Instance uuid 38c28ffa-560d-4223-b5b1-a78ebd83201f {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:32:55.840624 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-deb12a49-43f9-4e06-b964-0fa6db2040ee tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments/e46c3227-0755-4338-a204-6c2a01957227" status: 202 len: 0 microversion: 2.1 time: 0.322671 Jun 22 10:32:55.841425 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 601/1185] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jun 22 10:32:55 2022] DELETE /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments/e46c3227-0755-4338-a204-6c2a01957227 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:32:55.852146 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-74f0ff3e-2fd9-4819-a54f-72163a9e6410 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:55.853301 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-74f0ff3e-2fd9-4819-a54f-72163a9e6410 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:55.859913 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-74f0ff3e-2fd9-4819-a54f-72163a9e6410 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:55.860352 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-74f0ff3e-2fd9-4819-a54f-72163a9e6410 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:55.861138 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-74f0ff3e-2fd9-4819-a54f-72163a9e6410 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:55.862129 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-74f0ff3e-2fd9-4819-a54f-72163a9e6410 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:55.892981 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-74f0ff3e-2fd9-4819-a54f-72163a9e6410 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046677 Jun 22 10:32:55.893544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 585/1186] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:32:55 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:56.905492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9f621233-e134-4954-a7d7-b53daa7f39d6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:56.906507 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9f621233-e134-4954-a7d7-b53daa7f39d6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:56.913890 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9f621233-e134-4954-a7d7-b53daa7f39d6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:56.914341 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9f621233-e134-4954-a7d7-b53daa7f39d6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:56.915109 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9f621233-e134-4954-a7d7-b53daa7f39d6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:56.915556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9f621233-e134-4954-a7d7-b53daa7f39d6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:56.946051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9f621233-e134-4954-a7d7-b53daa7f39d6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Jun 22 10:32:56.946526 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 602/1187] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:32:56 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:57.958439 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8006314f-2833-4ffa-8cf6-595b87f3ede4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:57.959326 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8006314f-2833-4ffa-8cf6-595b87f3ede4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:57.965719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8006314f-2833-4ffa-8cf6-595b87f3ede4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:57.966170 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8006314f-2833-4ffa-8cf6-595b87f3ede4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:57.966928 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8006314f-2833-4ffa-8cf6-595b87f3ede4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:57.967366 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8006314f-2833-4ffa-8cf6-595b87f3ede4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:57.996292 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8006314f-2833-4ffa-8cf6-595b87f3ede4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042563 Jun 22 10:32:57.996875 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 586/1188] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:32:57 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:59.008460 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-28350d5f-9876-4732-a130-0e04877159e9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:59.009333 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-28350d5f-9876-4732-a130-0e04877159e9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:59.011722 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=25 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:59.016475 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-28350d5f-9876-4732-a130-0e04877159e9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:59.016972 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-28350d5f-9876-4732-a130-0e04877159e9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:59.018392 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-28350d5f-9876-4732-a130-0e04877159e9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:59.018837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-28350d5f-9876-4732-a130-0e04877159e9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:59.047921 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-28350d5f-9876-4732-a130-0e04877159e9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Jun 22 10:32:59.048474 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 603/1189] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:32:59 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:00.059828 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b396b43e-2c61-4d4e-bd97-9c9c678a63ba tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:00.060805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b396b43e-2c61-4d4e-bd97-9c9c678a63ba tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:00.067852 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b396b43e-2c61-4d4e-bd97-9c9c678a63ba tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:00.068297 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b396b43e-2c61-4d4e-bd97-9c9c678a63ba tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:00.069150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b396b43e-2c61-4d4e-bd97-9c9c678a63ba tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:00.069597 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b396b43e-2c61-4d4e-bd97-9c9c678a63ba tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:00.099126 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b396b43e-2c61-4d4e-bd97-9c9c678a63ba tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043271 Jun 22 10:33:00.099685 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 587/1190] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:33:00 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:01.110693 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f370abdc-25b1-45e1-8e80-b7fd75e98eeb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:01.111637 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f370abdc-25b1-45e1-8e80-b7fd75e98eeb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:01.118455 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f370abdc-25b1-45e1-8e80-b7fd75e98eeb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:01.118905 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f370abdc-25b1-45e1-8e80-b7fd75e98eeb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:01.119659 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f370abdc-25b1-45e1-8e80-b7fd75e98eeb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:01.120096 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f370abdc-25b1-45e1-8e80-b7fd75e98eeb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:01.123697 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:01.150402 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f370abdc-25b1-45e1-8e80-b7fd75e98eeb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043651 Jun 22 10:33:01.150984 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 604/1191] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:33:01 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:33:01.208154 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8c2593b6-6d09-4cb1-8a9c-2a784548c273 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:01.208640 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8c2593b6-6d09-4cb1-8a9c-2a784548c273 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:01.215253 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8c2593b6-6d09-4cb1-8a9c-2a784548c273 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:01.215720 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8c2593b6-6d09-4cb1-8a9c-2a784548c273 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:01.216485 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8c2593b6-6d09-4cb1-8a9c-2a784548c273 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:01.216959 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8c2593b6-6d09-4cb1-8a9c-2a784548c273 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:01.244501 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8c2593b6-6d09-4cb1-8a9c-2a784548c273 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:33:01.517624 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8c2593b6-6d09-4cb1-8a9c-2a784548c273 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 204 len: 0 microversion: 2.1 time: 0.313701 Jun 22 10:33:01.518294 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 588/1192] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:33:01 2022] DELETE /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:33:01.526892 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8a02fbec-86ef-4a14-963d-1ebb50e5dfd2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:01.527745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8a02fbec-86ef-4a14-963d-1ebb50e5dfd2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:01.534491 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8a02fbec-86ef-4a14-963d-1ebb50e5dfd2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:01.534950 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8a02fbec-86ef-4a14-963d-1ebb50e5dfd2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:01.535730 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8a02fbec-86ef-4a14-963d-1ebb50e5dfd2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:01.536165 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8a02fbec-86ef-4a14-963d-1ebb50e5dfd2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:01.674447 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8a02fbec-86ef-4a14-963d-1ebb50e5dfd2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:01.680157 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-8a02fbec-86ef-4a14-963d-1ebb50e5dfd2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1681 microversion: 2.1 time: 0.157445 Jun 22 10:33:01.680922 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 605/1193] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:01 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:02.696732 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-d0d8e345-4213-403c-bb4c-10c63d6a21f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:02.697466 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-d0d8e345-4213-403c-bb4c-10c63d6a21f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:02.704192 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d0d8e345-4213-403c-bb4c-10c63d6a21f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:02.704638 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d0d8e345-4213-403c-bb4c-10c63d6a21f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:02.705439 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d0d8e345-4213-403c-bb4c-10c63d6a21f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:02.705872 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-d0d8e345-4213-403c-bb4c-10c63d6a21f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:02.842018 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-d0d8e345-4213-403c-bb4c-10c63d6a21f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:02.850190 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-d0d8e345-4213-403c-bb4c-10c63d6a21f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1681 microversion: 2.1 time: 0.157600 Jun 22 10:33:02.850739 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 589/1194] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:02 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:03.875260 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7c334f6a-2c85-4a85-925b-be315b81d991 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:03.875260 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7c334f6a-2c85-4a85-925b-be315b81d991 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:03.875260 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7c334f6a-2c85-4a85-925b-be315b81d991 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:03.876628 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-78173864-6009-48fe-8cf7-188e7d0f546c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:03.877022 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7c334f6a-2c85-4a85-925b-be315b81d991 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:03.877116 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-78173864-6009-48fe-8cf7-188e7d0f546c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:03.877216 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7c334f6a-2c85-4a85-925b-be315b81d991 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:03.877216 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7c334f6a-2c85-4a85-925b-be315b81d991 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:03.877371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-78173864-6009-48fe-8cf7-188e7d0f546c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:03.877371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-78173864-6009-48fe-8cf7-188e7d0f546c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:03.877371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-78173864-6009-48fe-8cf7-188e7d0f546c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:03.877371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-78173864-6009-48fe-8cf7-188e7d0f546c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:03.955157 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-7c334f6a-2c85-4a85-925b-be315b81d991 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lazy-loading 'services' on Instance uuid 2ff1affd-58cc-4cff-89b3-6d45bf964537 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:33:04.110373 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-78173864-6009-48fe-8cf7-188e7d0f546c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:04.119281 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-78173864-6009-48fe-8cf7-188e7d0f546c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1681 microversion: 2.1 time: 0.255198 Jun 22 10:33:04.119864 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 590/1195] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:03 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1681 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:33:04.192030 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7c334f6a-2c85-4a85-925b-be315b81d991 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537/os-volume_attachments/fc5014cb-3fe7-4470-8d96-0466e4f67858" status: 202 len: 0 microversion: 2.1 time: 0.336536 Jun 22 10:33:04.192549 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 606/1196] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jun 22 10:33:03 2022] DELETE /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537/os-volume_attachments/fc5014cb-3fe7-4470-8d96-0466e4f67858 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:33:04.735476 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-3d1de711-ba52-4da2-8c5b-889420d6b970 req-2b67d693-3b55-43a4-9759-a6b7cf863316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c28ffa-560d-4223-b5b1-a78ebd83201f", "name": "network-vif-deleted", "tag": "ea83d8f8-1c9f-4539-9896-f158ce55ca4b"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:04.743969 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-3d1de711-ba52-4da2-8c5b-889420d6b970 req-2b67d693-3b55-43a4-9759-a6b7cf863316 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:04.744746 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-3d1de711-ba52-4da2-8c5b-889420d6b970 req-2b67d693-3b55-43a4-9759-a6b7cf863316 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:04.757098 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-3d1de711-ba52-4da2-8c5b-889420d6b970 req-2b67d693-3b55-43a4-9759-a6b7cf863316 service nova] Creating event network-vif-deleted:ea83d8f8-1c9f-4539-9896-f158ce55ca4b for instance 38c28ffa-560d-4223-b5b1-a78ebd83201f on hv-cinder-84327 Jun 22 10:33:04.762551 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-3d1de711-ba52-4da2-8c5b-889420d6b970 req-2b67d693-3b55-43a4-9759-a6b7cf863316 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030687 Jun 22 10:33:04.763159 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 591/1197] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:05.144784 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a58d2025-d8c1-492e-a772-b6dcbb303c09 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:05.145760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a58d2025-d8c1-492e-a772-b6dcbb303c09 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:05.152891 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a58d2025-d8c1-492e-a772-b6dcbb303c09 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:05.153352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a58d2025-d8c1-492e-a772-b6dcbb303c09 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:05.154139 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a58d2025-d8c1-492e-a772-b6dcbb303c09 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:05.154605 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a58d2025-d8c1-492e-a772-b6dcbb303c09 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:05.189793 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a58d2025-d8c1-492e-a772-b6dcbb303c09 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:05.190248 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a58d2025-d8c1-492e-a772-b6dcbb303c09 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:05.191327 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-a58d2025-d8c1-492e-a772-b6dcbb303c09 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lazy-loading 'fault' on Instance uuid 38c28ffa-560d-4223-b5b1-a78ebd83201f {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:33:05.235601 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a58d2025-d8c1-492e-a772-b6dcbb303c09 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:05.243831 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a58d2025-d8c1-492e-a772-b6dcbb303c09 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 200 len: 1330 microversion: 2.1 time: 0.103797 Jun 22 10:33:05.244544 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 607/1198] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:05 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:05.333103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1f74c67c-4a24-49ad-b2c8-a3d087059030 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:05.333674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1f74c67c-4a24-49ad-b2c8-a3d087059030 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:05.339904 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1f74c67c-4a24-49ad-b2c8-a3d087059030 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:05.340339 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1f74c67c-4a24-49ad-b2c8-a3d087059030 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:05.341126 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1f74c67c-4a24-49ad-b2c8-a3d087059030 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:05.341554 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1f74c67c-4a24-49ad-b2c8-a3d087059030 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:05.368074 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1f74c67c-4a24-49ad-b2c8-a3d087059030 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:33:05.859885 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1f74c67c-4a24-49ad-b2c8-a3d087059030 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 204 len: 0 microversion: 2.1 time: 0.531161 Jun 22 10:33:05.860509 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 592/1199] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:33:05 2022] DELETE /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:33:05.869450 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7e289a8d-15d5-4e29-ab2a-72a468625176 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:05.870109 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7e289a8d-15d5-4e29-ab2a-72a468625176 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:05.876460 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7e289a8d-15d5-4e29-ab2a-72a468625176 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:05.876946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7e289a8d-15d5-4e29-ab2a-72a468625176 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:05.877719 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7e289a8d-15d5-4e29-ab2a-72a468625176 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:05.878738 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7e289a8d-15d5-4e29-ab2a-72a468625176 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:06.011766 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7e289a8d-15d5-4e29-ab2a-72a468625176 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:06.019314 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7e289a8d-15d5-4e29-ab2a-72a468625176 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1513 microversion: 2.1 time: 0.153778 Jun 22 10:33:06.021697 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 608/1200] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:05 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:33:06.262360 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-11501243-efa2-4bd5-9c8b-8b96d86434d4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:06.262976 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-11501243-efa2-4bd5-9c8b-8b96d86434d4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:06.269689 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-11501243-efa2-4bd5-9c8b-8b96d86434d4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:06.270137 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-11501243-efa2-4bd5-9c8b-8b96d86434d4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:06.270902 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-11501243-efa2-4bd5-9c8b-8b96d86434d4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:06.271335 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-11501243-efa2-4bd5-9c8b-8b96d86434d4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:06.284767 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-11501243-efa2-4bd5-9c8b-8b96d86434d4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-11501243-efa2-4bd5-9c8b-8b96d86434d4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f HTTP/1.1 Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:33:06.286407 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:33:06.288147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:33:06.288147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:33:06.288147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:33:06.288147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:33:06.288147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:33:06.288147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:33:06.288147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:33:06.288147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:33:06.288147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:33:06.288147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:33:06.288147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:33:06.288147 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '38c28ffa-560d-4223-b5b1-a78ebd83201f'} Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:33:06.289131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:33:06.290710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:33:06.292035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-11501243-efa2-4bd5-9c8b-8b96d86434d4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 404 to user: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:33:06.292035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-11501243-efa2-4bd5-9c8b-8b96d86434d4 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 404 len: 111 microversion: 2.1 time: 0.029835 Jun 22 10:33:06.292035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 593/1201] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:06 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:33:06.296678 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3c187fa7-48b3-4a5f-a4dc-07fd947b3467 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '.version_select at 0x7f021fdae670>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:06.373440 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3c187fa7-48b3-4a5f-a4dc-07fd947b3467 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-107258870" status: 202 len: 0 microversion: 2.1 time: 0.080423 Jun 22 10:33:06.374025 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 609/1202] 10.222.0.46 () {58 vars in 1217 bytes} [Wed Jun 22 10:33:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-107258870 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:33:07.037826 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-fde938ba-07dc-4a4d-90dc-1090fb569d9c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:07.038538 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-fde938ba-07dc-4a4d-90dc-1090fb569d9c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:07.045117 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fde938ba-07dc-4a4d-90dc-1090fb569d9c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:07.045765 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fde938ba-07dc-4a4d-90dc-1090fb569d9c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:07.046583 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fde938ba-07dc-4a4d-90dc-1090fb569d9c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:07.047016 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fde938ba-07dc-4a4d-90dc-1090fb569d9c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:07.232958 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-fde938ba-07dc-4a4d-90dc-1090fb569d9c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:07.240598 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-fde938ba-07dc-4a4d-90dc-1090fb569d9c tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1513 microversion: 2.1 time: 0.207190 Jun 22 10:33:07.242044 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 594/1203] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:07 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:07.414296 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-33ea4727-93e5-4cc0-a70d-4cf1afa18cc3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: .version_select at 0x7f021fdda4c0>, body: {"keypair": {"name": "tempest-keypair-1724279974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzofv2mNjF13Ckb/jXNr6H0fqLRclYN8D70I+VuXtdCPA6f5e7jOnbKpbJQMqUGkQag7/+CqdoJ8qJUSQqkmkdsASHN0/qxQsCnkLUq48rHpkAOQ9NpMHwP2Oy5zwzVzQ=="}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:07.429018 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-33ea4727-93e5-4cc0-a70d-4cf1afa18cc3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for project 347c4ccbcb464091b8254475babf2874. Resources: {'key_pairs'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:33:07.432946 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-33ea4727-93e5-4cc0-a70d-4cf1afa18cc3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for user 082ece6ea4244242a6ba99152572c80f and project 347c4ccbcb464091b8254475babf2874. Resources: {'key_pairs'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:33:07.553484 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-33ea4727-93e5-4cc0-a70d-4cf1afa18cc3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.144028 Jun 22 10:33:07.554128 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 610/1204] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jun 22 10:33:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:08.258271 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-ba71e462-518b-43e1-9dfa-b53fc7ebb4fb tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:08.258909 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-ba71e462-518b-43e1-9dfa-b53fc7ebb4fb tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:08.265954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ba71e462-518b-43e1-9dfa-b53fc7ebb4fb tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:08.266411 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ba71e462-518b-43e1-9dfa-b53fc7ebb4fb tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:08.267189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ba71e462-518b-43e1-9dfa-b53fc7ebb4fb tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:08.267635 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-ba71e462-518b-43e1-9dfa-b53fc7ebb4fb tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:08.463261 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-ba71e462-518b-43e1-9dfa-b53fc7ebb4fb tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:08.471130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-ba71e462-518b-43e1-9dfa-b53fc7ebb4fb tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1513 microversion: 2.1 time: 0.217341 Jun 22 10:33:08.471794 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 595/1205] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:08 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:08.641404 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-07da0802-85a7-4890-bed9-5030adbfb864 req-64c4182f-eefd-421e-aa80-84da1d707865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff1affd-58cc-4cff-89b3-6d45bf964537", "name": "network-vif-deleted", "tag": "6d4c4563-2787-4037-bc84-4b103ec19051"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:08.650212 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-07da0802-85a7-4890-bed9-5030adbfb864 req-64c4182f-eefd-421e-aa80-84da1d707865 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:08.650749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-07da0802-85a7-4890-bed9-5030adbfb864 req-64c4182f-eefd-421e-aa80-84da1d707865 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:08.662519 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-07da0802-85a7-4890-bed9-5030adbfb864 req-64c4182f-eefd-421e-aa80-84da1d707865 service nova] Creating event network-vif-deleted:6d4c4563-2787-4037-bc84-4b103ec19051 for instance 2ff1affd-58cc-4cff-89b3-6d45bf964537 on hv-cinder-84327 Jun 22 10:33:08.669204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-07da0802-85a7-4890-bed9-5030adbfb864 req-64c4182f-eefd-421e-aa80-84da1d707865 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032233 Jun 22 10:33:08.669825 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 611/1206] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:09.489189 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-cdc6d6bf-a46c-4807-bc05-f7214390c6c7 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:09.489928 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-cdc6d6bf-a46c-4807-bc05-f7214390c6c7 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:09.496733 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cdc6d6bf-a46c-4807-bc05-f7214390c6c7 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:09.498110 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cdc6d6bf-a46c-4807-bc05-f7214390c6c7 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:09.499172 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cdc6d6bf-a46c-4807-bc05-f7214390c6c7 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:09.499808 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cdc6d6bf-a46c-4807-bc05-f7214390c6c7 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:09.533336 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cdc6d6bf-a46c-4807-bc05-f7214390c6c7 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:09.533817 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-cdc6d6bf-a46c-4807-bc05-f7214390c6c7 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:09.534348 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-cdc6d6bf-a46c-4807-bc05-f7214390c6c7 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lazy-loading 'fault' on Instance uuid 2ff1affd-58cc-4cff-89b3-6d45bf964537 {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:33:09.579823 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-cdc6d6bf-a46c-4807-bc05-f7214390c6c7 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50ad963ccc5b4504a0e5bc7751fc76cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec35c44695245b2ab61de1996ceb0ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:09.585780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-cdc6d6bf-a46c-4807-bc05-f7214390c6c7 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 200 len: 1308 microversion: 2.1 time: 0.100890 Jun 22 10:33:09.586359 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 596/1207] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:09 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:09.714463 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1498254136", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50c0d4d4-6a37-4a0f-93d4-ead4b389795a"}], "security_groups": [{"name": "tempest-securitygroup--1153194961"}], "key_name": "tempest-keypair-1724279974", "user_data": "}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:09.816801 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.network.neutron [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] validate_networks() for [('50c0d4d4-6a37-4a0f-93d4-ead4b389795a', None, None, None, None, None)] {{(pid=118327) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:33:10.271884 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Flavor limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:33:10.272302 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Image limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:33:10.272773 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Flavor pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:33:10.273202 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Image pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:33:10.273880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:33:10.282556 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:10.282995 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:10.283776 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:10.284206 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:10.300975 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for project 347c4ccbcb464091b8254475babf2874. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:33:10.304960 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Getting quotas for user 082ece6ea4244242a6ba99152572c80f and project 347c4ccbcb464091b8254475babf2874. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:33:10.315674 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Going to run 1 instances... {{(pid=118327) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:33:10.318734 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:33:10.444180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-8802acca-ffa2-4558-9773-399e0eac58ce tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.734658 Jun 22 10:33:10.444859 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 612/1208] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:33:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:33:10.454792 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-864034f9-7216-4f1f-b8d5-6c93a5579296 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:10.455433 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-864034f9-7216-4f1f-b8d5-6c93a5579296 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:10.518251 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-864034f9-7216-4f1f-b8d5-6c93a5579296 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:10.527208 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-864034f9-7216-4f1f-b8d5-6c93a5579296 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1242 microversion: 2.1 time: 0.076196 Jun 22 10:33:10.527878 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 597/1209] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:10 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:10.603219 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-50c55543-21e1-4ee4-99ff-aeae6e5eb535 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:10.603921 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-50c55543-21e1-4ee4-99ff-aeae6e5eb535 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] [instance: 2ff1affd-58cc-4cff-89b3-6d45bf964537] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:10.610911 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-50c55543-21e1-4ee4-99ff-aeae6e5eb535 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:10.611368 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-50c55543-21e1-4ee4-99ff-aeae6e5eb535 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:10.612139 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-50c55543-21e1-4ee4-99ff-aeae6e5eb535 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:10.612583 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-50c55543-21e1-4ee4-99ff-aeae6e5eb535 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:10.626690 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-50c55543-21e1-4ee4-99ff-aeae6e5eb535 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] HTTP exception thrown: Instance 2ff1affd-58cc-4cff-89b3-6d45bf964537 could not be found. Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-50c55543-21e1-4ee4-99ff-aeae6e5eb535 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Request method failure captured: Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 HTTP/1.1 Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu9jhL0aa7M8eknfKDNy09CCMcpQLNY69aEIZvOivL92r-wdUX6VJdWFDU_m0qCiccgbqRQy0zvAzB4CPjfS0b8oJ7oVSRiiZRmFzRRTIEHjPUO-53lVuKepmrHBLD4XAscrWNLi5P_8xbwKrGLI8Cdj0LnCwq2DOqgdKOOi2MQE9Ag Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 4ec35c44695245b2ab61de1996ceb0ac Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-VolumesSnapshotTestJSON-624019428 Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:33:10.628354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:33:10.630105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ec35c44695245b2ab61de1996ceb0ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_4ec35c44695245b2ab61de1996ceb0ac", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/4ec35c44695245b2ab61de1996ceb0ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/4ec35c44695245b2ab61de1996ceb0ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:33:10.630105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-VolumesSnapshotTestJSON-624019428 Jun 22 10:33:10.630105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 4ec35c44695245b2ab61de1996ceb0ac Jun 22 10:33:10.630105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-624019428 Jun 22 10:33:10.630105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-VolumesSnapshotTestJSON-624019428-project Jun 22 10:33:10.630105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:33:10.630105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:33:10.630105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 50ad963ccc5b4504a0e5bc7751fc76cf Jun 22 10:33:10.630105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-VolumesSnapshotTestJSON-624019428-project Jun 22 10:33:10.630105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:33:10.630105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 2ff1affd-58cc-4cff-89b3-6d45bf964537 could not be found. Jun 22 10:33:10.630105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '2ff1affd-58cc-4cff-89b3-6d45bf964537'} Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff1affd-58cc-4cff-89b3-6d45bf964537 could not be found. Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:33:10.631038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff1affd-58cc-4cff-89b3-6d45bf964537 could not be found. Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff1affd-58cc-4cff-89b3-6d45bf964537 could not be found. Jun 22 10:33:10.632651 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:33:10.634018 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-50c55543-21e1-4ee4-99ff-aeae6e5eb535 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] Returning 404 to user: Instance 2ff1affd-58cc-4cff-89b3-6d45bf964537 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:33:10.634018 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-50c55543-21e1-4ee4-99ff-aeae6e5eb535 tempest-VolumesSnapshotTestJSON-624019428 tempest-VolumesSnapshotTestJSON-624019428-project] 10.222.0.46 "GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537" status: 404 len: 111 microversion: 2.1 time: 0.030566 Jun 22 10:33:10.634018 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 613/1210] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:10 2022] GET /compute/v2.1/servers/2ff1affd-58cc-4cff-89b3-6d45bf964537 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:33:11.544132 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-bb5569d5-1716-41b1-8452-f188de0f91f0 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:11.544738 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-bb5569d5-1716-41b1-8452-f188de0f91f0 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:11.552909 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb5569d5-1716-41b1-8452-f188de0f91f0 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:11.553897 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb5569d5-1716-41b1-8452-f188de0f91f0 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:11.554188 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb5569d5-1716-41b1-8452-f188de0f91f0 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:11.554631 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-bb5569d5-1716-41b1-8452-f188de0f91f0 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:11.619224 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-bb5569d5-1716-41b1-8452-f188de0f91f0 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:11.626784 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-bb5569d5-1716-41b1-8452-f188de0f91f0 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1246 microversion: 2.1 time: 0.086643 Jun 22 10:33:11.627370 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 598/1211] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:11 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:12.643427 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5f8e10ce-8604-43e5-92d0-56b8a4af9216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:12.644043 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5f8e10ce-8604-43e5-92d0-56b8a4af9216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:12.651056 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5f8e10ce-8604-43e5-92d0-56b8a4af9216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:12.651446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5f8e10ce-8604-43e5-92d0-56b8a4af9216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:12.652208 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5f8e10ce-8604-43e5-92d0-56b8a4af9216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:12.652641 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5f8e10ce-8604-43e5-92d0-56b8a4af9216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:12.718143 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5f8e10ce-8604-43e5-92d0-56b8a4af9216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:12.726631 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5f8e10ce-8604-43e5-92d0-56b8a4af9216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1312 microversion: 2.1 time: 0.086901 Jun 22 10:33:12.727302 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 614/1212] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:12 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1312 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:13.743435 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-216390f9-4728-4b31-94ce-ab47d6c69882 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:13.744141 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-216390f9-4728-4b31-94ce-ab47d6c69882 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:13.750513 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-216390f9-4728-4b31-94ce-ab47d6c69882 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:13.750951 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-216390f9-4728-4b31-94ce-ab47d6c69882 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:13.751703 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-216390f9-4728-4b31-94ce-ab47d6c69882 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:13.752130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-216390f9-4728-4b31-94ce-ab47d6c69882 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:13.756718 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:13.885038 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-216390f9-4728-4b31-94ce-ab47d6c69882 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:13.892428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-216390f9-4728-4b31-94ce-ab47d6c69882 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.152865 Jun 22 10:33:13.893035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 599/1213] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:13 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:14.910478 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9d325051-0cac-4608-b90e-b0573ee3f132 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:14.911084 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9d325051-0cac-4608-b90e-b0573ee3f132 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:14.918417 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d325051-0cac-4608-b90e-b0573ee3f132 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:14.918805 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d325051-0cac-4608-b90e-b0573ee3f132 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:14.919655 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d325051-0cac-4608-b90e-b0573ee3f132 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:14.920134 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9d325051-0cac-4608-b90e-b0573ee3f132 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:15.056745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9d325051-0cac-4608-b90e-b0573ee3f132 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:15.064688 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9d325051-0cac-4608-b90e-b0573ee3f132 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.158106 Jun 22 10:33:15.065298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 615/1214] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:14 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:15.956088 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-b67ca5a4-1dc1-43ad-ba1b-a654af7adbb5 req-068029f4-2968-4f98-b2a5-80cfa3ca349c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a382416-0f8f-4dd3-8402-b095a9c19fc7", "tag": "112930e8-3db4-4a53-aafa-c574837adfb5"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:15.969443 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-b67ca5a4-1dc1-43ad-ba1b-a654af7adbb5 req-068029f4-2968-4f98-b2a5-80cfa3ca349c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:15.971202 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-b67ca5a4-1dc1-43ad-ba1b-a654af7adbb5 req-068029f4-2968-4f98-b2a5-80cfa3ca349c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:15.988487 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-b67ca5a4-1dc1-43ad-ba1b-a654af7adbb5 req-068029f4-2968-4f98-b2a5-80cfa3ca349c service nova] Creating event network-changed:112930e8-3db4-4a53-aafa-c574837adfb5 for instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 on hv-cinder-84327 Jun 22 10:33:15.994358 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-b67ca5a4-1dc1-43ad-ba1b-a654af7adbb5 req-068029f4-2968-4f98-b2a5-80cfa3ca349c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041855 Jun 22 10:33:15.995003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 600/1215] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:16.081325 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ede8c4a8-5490-401c-b35a-d8325e57fd15 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:16.081942 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-ede8c4a8-5490-401c-b35a-d8325e57fd15 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:16.088736 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ede8c4a8-5490-401c-b35a-d8325e57fd15 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:16.089224 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ede8c4a8-5490-401c-b35a-d8325e57fd15 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:16.090007 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ede8c4a8-5490-401c-b35a-d8325e57fd15 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:16.090445 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-ede8c4a8-5490-401c-b35a-d8325e57fd15 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:16.224255 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-ede8c4a8-5490-401c-b35a-d8325e57fd15 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:16.232471 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ede8c4a8-5490-401c-b35a-d8325e57fd15 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.155049 Jun 22 10:33:16.233084 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 616/1216] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:16 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:17.250154 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2a64ee18-a49e-4989-ad31-3dc7e592fff3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:17.250882 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2a64ee18-a49e-4989-ad31-3dc7e592fff3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:17.257788 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2a64ee18-a49e-4989-ad31-3dc7e592fff3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:17.258240 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2a64ee18-a49e-4989-ad31-3dc7e592fff3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:17.259012 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2a64ee18-a49e-4989-ad31-3dc7e592fff3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:17.259449 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2a64ee18-a49e-4989-ad31-3dc7e592fff3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:17.389177 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2a64ee18-a49e-4989-ad31-3dc7e592fff3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:17.396582 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2a64ee18-a49e-4989-ad31-3dc7e592fff3 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.151607 Jun 22 10:33:17.397188 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 601/1217] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:17 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:18.415884 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-470e9d3a-bd3d-4416-a8b6-b001bb5eeff8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:18.416493 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-470e9d3a-bd3d-4416-a8b6-b001bb5eeff8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:18.423200 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-470e9d3a-bd3d-4416-a8b6-b001bb5eeff8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:18.423652 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-470e9d3a-bd3d-4416-a8b6-b001bb5eeff8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:18.424490 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-470e9d3a-bd3d-4416-a8b6-b001bb5eeff8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:18.424869 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-470e9d3a-bd3d-4416-a8b6-b001bb5eeff8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:18.555760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-470e9d3a-bd3d-4416-a8b6-b001bb5eeff8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:18.563126 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-470e9d3a-bd3d-4416-a8b6-b001bb5eeff8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.151614 Jun 22 10:33:18.564592 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 617/1218] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:18 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:19.580382 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-90f513f5-ac20-4d01-b880-c446ccb861cb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:19.581027 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-90f513f5-ac20-4d01-b880-c446ccb861cb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:19.588062 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-90f513f5-ac20-4d01-b880-c446ccb861cb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:19.588543 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-90f513f5-ac20-4d01-b880-c446ccb861cb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:19.589340 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-90f513f5-ac20-4d01-b880-c446ccb861cb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:19.589780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-90f513f5-ac20-4d01-b880-c446ccb861cb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:19.726773 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-90f513f5-ac20-4d01-b880-c446ccb861cb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:19.734395 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-90f513f5-ac20-4d01-b880-c446ccb861cb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.157829 Jun 22 10:33:19.734962 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 602/1219] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:19 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:20.750738 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-cc8f4df5-0309-4f31-b691-9b04d6be2f2c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:20.751458 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-cc8f4df5-0309-4f31-b691-9b04d6be2f2c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:20.754074 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:20.754738 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=10 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:20.760662 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cc8f4df5-0309-4f31-b691-9b04d6be2f2c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:20.761144 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cc8f4df5-0309-4f31-b691-9b04d6be2f2c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:20.762069 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cc8f4df5-0309-4f31-b691-9b04d6be2f2c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:20.762534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-cc8f4df5-0309-4f31-b691-9b04d6be2f2c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:20.975916 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-cc8f4df5-0309-4f31-b691-9b04d6be2f2c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:20.984414 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-cc8f4df5-0309-4f31-b691-9b04d6be2f2c tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.237669 Jun 22 10:33:20.985141 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 618/1220] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:20 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:22.001998 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a822f9d6-ff38-4128-829d-5bcdee231e4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:22.002541 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a822f9d6-ff38-4128-829d-5bcdee231e4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:22.004433 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:22.010343 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a822f9d6-ff38-4128-829d-5bcdee231e4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:22.010787 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a822f9d6-ff38-4128-829d-5bcdee231e4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:22.011560 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a822f9d6-ff38-4128-829d-5bcdee231e4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:22.011992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a822f9d6-ff38-4128-829d-5bcdee231e4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:22.145467 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a822f9d6-ff38-4128-829d-5bcdee231e4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:22.153423 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a822f9d6-ff38-4128-829d-5bcdee231e4f tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.155465 Jun 22 10:33:22.153992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 603/1221] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:21 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:23.023853 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-93666558-3420-431d-ba4f-333f35271fcb req-8611dd22-59cd-4a85-921f-dfa40963ee39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a382416-0f8f-4dd3-8402-b095a9c19fc7", "name": "network-vif-plugged", "status": "completed", "tag": "112930e8-3db4-4a53-aafa-c574837adfb5"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:23.033191 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-93666558-3420-431d-ba4f-333f35271fcb req-8611dd22-59cd-4a85-921f-dfa40963ee39 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:23.033837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-93666558-3420-431d-ba4f-333f35271fcb req-8611dd22-59cd-4a85-921f-dfa40963ee39 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:23.047594 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-93666558-3420-431d-ba4f-333f35271fcb req-8611dd22-59cd-4a85-921f-dfa40963ee39 service nova] Creating event network-vif-plugged:112930e8-3db4-4a53-aafa-c574837adfb5 for instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 on hv-cinder-84327 Jun 22 10:33:23.052748 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-93666558-3420-431d-ba4f-333f35271fcb req-8611dd22-59cd-4a85-921f-dfa40963ee39 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033096 Jun 22 10:33:23.053389 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 619/1222] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:23.172493 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2ff31595-c5b4-4970-961c-e598b7418276 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:23.173079 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2ff31595-c5b4-4970-961c-e598b7418276 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:23.180059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2ff31595-c5b4-4970-961c-e598b7418276 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:23.180509 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2ff31595-c5b4-4970-961c-e598b7418276 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:23.181305 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2ff31595-c5b4-4970-961c-e598b7418276 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:23.181743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2ff31595-c5b4-4970-961c-e598b7418276 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:23.373177 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-2ff31595-c5b4-4970-961c-e598b7418276 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:23.380745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2ff31595-c5b4-4970-961c-e598b7418276 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.212184 Jun 22 10:33:23.381355 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 604/1223] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:23 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:24.399077 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-84183841-3472-43b6-8251-97c9c15344bf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:24.399716 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-84183841-3472-43b6-8251-97c9c15344bf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:24.405966 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-84183841-3472-43b6-8251-97c9c15344bf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:24.407577 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-84183841-3472-43b6-8251-97c9c15344bf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:24.407577 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-84183841-3472-43b6-8251-97c9c15344bf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:24.407577 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-84183841-3472-43b6-8251-97c9c15344bf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:24.539971 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-84183841-3472-43b6-8251-97c9c15344bf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:24.547449 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-84183841-3472-43b6-8251-97c9c15344bf tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.153394 Jun 22 10:33:24.548054 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 620/1224] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:24 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:25.564573 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-0d34dfcc-394b-42cc-bd9b-88df1fef1cf6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:25.565212 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-0d34dfcc-394b-42cc-bd9b-88df1fef1cf6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:25.572146 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0d34dfcc-394b-42cc-bd9b-88df1fef1cf6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:25.572591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0d34dfcc-394b-42cc-bd9b-88df1fef1cf6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:25.573374 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0d34dfcc-394b-42cc-bd9b-88df1fef1cf6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:25.573835 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-0d34dfcc-394b-42cc-bd9b-88df1fef1cf6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:25.703073 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-0d34dfcc-394b-42cc-bd9b-88df1fef1cf6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:25.712475 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-0d34dfcc-394b-42cc-bd9b-88df1fef1cf6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.151659 Jun 22 10:33:25.713250 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 605/1225] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:25 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:26.729839 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-018b59fa-3f1f-40fe-b1e1-8974c50fcca9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:26.730451 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-018b59fa-3f1f-40fe-b1e1-8974c50fcca9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:26.737049 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-018b59fa-3f1f-40fe-b1e1-8974c50fcca9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:26.737497 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-018b59fa-3f1f-40fe-b1e1-8974c50fcca9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:26.738262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-018b59fa-3f1f-40fe-b1e1-8974c50fcca9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:26.738694 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-018b59fa-3f1f-40fe-b1e1-8974c50fcca9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:26.896420 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-018b59fa-3f1f-40fe-b1e1-8974c50fcca9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:26.904390 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-018b59fa-3f1f-40fe-b1e1-8974c50fcca9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.179104 Jun 22 10:33:26.904991 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 621/1226] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:26 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:27.922159 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-fdea59b6-041b-40ef-8c61-44e70297dffe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:27.922691 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-fdea59b6-041b-40ef-8c61-44e70297dffe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:27.925478 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:27.930528 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fdea59b6-041b-40ef-8c61-44e70297dffe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:27.930985 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fdea59b6-041b-40ef-8c61-44e70297dffe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:27.931762 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fdea59b6-041b-40ef-8c61-44e70297dffe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:27.932202 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fdea59b6-041b-40ef-8c61-44e70297dffe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:28.063815 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-fdea59b6-041b-40ef-8c61-44e70297dffe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:28.071974 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-fdea59b6-041b-40ef-8c61-44e70297dffe tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1368 microversion: 2.1 time: 0.153770 Jun 22 10:33:28.072539 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 606/1227] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:27 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:29.089845 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-740627d0-9d3b-477d-b901-07617c054fc9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:29.090763 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-740627d0-9d3b-477d-b901-07617c054fc9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:29.097941 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-740627d0-9d3b-477d-b901-07617c054fc9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:29.098393 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-740627d0-9d3b-477d-b901-07617c054fc9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:29.101261 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-740627d0-9d3b-477d-b901-07617c054fc9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:29.101261 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-740627d0-9d3b-477d-b901-07617c054fc9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:29.233169 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-740627d0-9d3b-477d-b901-07617c054fc9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:29.240954 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-740627d0-9d3b-477d-b901-07617c054fc9 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1558 microversion: 2.1 time: 0.155259 Jun 22 10:33:29.242169 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 622/1228] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:29 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:29.258045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e8b665b9-81a8-4eb1-81b1-9b67ded73b73 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:29.258578 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e8b665b9-81a8-4eb1-81b1-9b67ded73b73 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:29.265779 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e8b665b9-81a8-4eb1-81b1-9b67ded73b73 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:29.266230 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e8b665b9-81a8-4eb1-81b1-9b67ded73b73 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:29.267002 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e8b665b9-81a8-4eb1-81b1-9b67ded73b73 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:29.267440 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e8b665b9-81a8-4eb1-81b1-9b67ded73b73 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:29.350399 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e8b665b9-81a8-4eb1-81b1-9b67ded73b73 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096349 Jun 22 10:33:29.351587 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 607/1229] 10.222.0.46 () {58 vars in 1274 bytes} [Wed Jun 22 10:33:29 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:30.695290 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-256f7d13-2b62-4341-a694-2f8841eafca8 req-e0019f2a-9ca6-4033-baeb-51b1f384e960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a382416-0f8f-4dd3-8402-b095a9c19fc7", "tag": "112930e8-3db4-4a53-aafa-c574837adfb5"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:30.703984 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-256f7d13-2b62-4341-a694-2f8841eafca8 req-e0019f2a-9ca6-4033-baeb-51b1f384e960 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:30.704430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-256f7d13-2b62-4341-a694-2f8841eafca8 req-e0019f2a-9ca6-4033-baeb-51b1f384e960 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:30.719186 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-256f7d13-2b62-4341-a694-2f8841eafca8 req-e0019f2a-9ca6-4033-baeb-51b1f384e960 service nova] Creating event network-changed:112930e8-3db4-4a53-aafa-c574837adfb5 for instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 on hv-cinder-84327 Jun 22 10:33:30.722519 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-256f7d13-2b62-4341-a694-2f8841eafca8 req-e0019f2a-9ca6-4033-baeb-51b1f384e960 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103992 Jun 22 10:33:30.723221 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 623/1230] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:36.127756 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:33:36.128254 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Wed Jun 22 10:33:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:33:54.069113 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=46 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:54.266062 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a37bd54a-e28d-4e67-98c5-ccff66aebda5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Action: 'create', calling method: .version_select at 0x7f021fe12ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1091582237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMKWul6nf25Y310a/XPp/MomIUprQV4b169X2vjMgCgvIjw5yaFb8shfl7Z2cnFyfOMwZ/EsBlU/QsZex9TMS5GOGEt8ImvXuJ9PntZoe/2tmvNNPUctqgk3Pf6oVeI6A=="}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:54.282456 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-a37bd54a-e28d-4e67-98c5-ccff66aebda5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Getting quotas for project 7ed0bebe0a884b0b96282770ef35b22e. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:33:54.286706 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-a37bd54a-e28d-4e67-98c5-ccff66aebda5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Getting quotas for user ce996aac321f4f39a4fb8bc759020a6d and project 7ed0bebe0a884b0b96282770ef35b22e. Resources: {'key_pairs'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:33:54.409113 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a37bd54a-e28d-4e67-98c5-ccff66aebda5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.341419 Jun 22 10:33:54.414688 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 608/1231] 10.222.0.46 () {60 vars in 1158 bytes} [Wed Jun 22 10:33:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:34:19.115702 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-701472670", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1091582237", "security_groups": [{"name": "tempest-secgroup-smoke-442086472"}], "networks": [{"uuid": "9201733f-9fea-4459-bc0a-304a668a8f0c"}], "block_device_mapping_v2": [{"uuid": "4053ec3c-3c71-4509-914d-f422ee09da54", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:34:19.123933 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:19.124603 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:19.229062 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.network.neutron [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] validate_networks() for [('9201733f-9fea-4459-bc0a-304a668a8f0c', None, None, None, None, None)] {{(pid=118327) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:34:19.593726 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Flavor limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:34:19.594149 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Image limits 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:34:19.594648 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Flavor pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:34:19.595051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Image pref 0:0:0 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:34:19.595457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.virt.hardware [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:34:19.605749 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:19.606191 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:19.606973 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:19.607401 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:19.624260 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Getting quotas for project 7ed0bebe0a884b0b96282770ef35b22e. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:34:19.628136 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.quota [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Getting quotas for user ce996aac321f4f39a4fb8bc759020a6d and project 7ed0bebe0a884b0b96282770ef35b22e. Resources: {'instances', 'ram', 'cores'} {{(pid=118327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:34:19.690786 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Going to run 1 instances... {{(pid=118327) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:34:19.693695 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4053ec3c-3c71-4509-914d-f422ee09da54',volume_size=None,volume_type=None)] {{(pid=118327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:34:20.114480 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-27747af7-7741-4947-aa2a-10e17f6745fa tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.003610 Jun 22 10:34:20.115673 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 624/1232] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:34:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 10:34:20.123212 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=4 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:20.123995 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:20.128419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-47fda069-d47e-4de3-8c70-188a6babf113 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:20.128536 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-47fda069-d47e-4de3-8c70-188a6babf113 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:20.190715 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-47fda069-d47e-4de3-8c70-188a6babf113 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:20.198233 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-47fda069-d47e-4de3-8c70-188a6babf113 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1088 microversion: 2.1 time: 0.076403 Jun 22 10:34:20.198824 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 609/1233] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:20 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:21.216194 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f8aaed10-f5f6-40ff-9c6a-5a560dac0546 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:21.216780 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f8aaed10-f5f6-40ff-9c6a-5a560dac0546 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:21.269435 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f8aaed10-f5f6-40ff-9c6a-5a560dac0546 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:21.277275 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f8aaed10-f5f6-40ff-9c6a-5a560dac0546 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1088 microversion: 2.1 time: 0.065367 Jun 22 10:34:21.277840 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 625/1234] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:21 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:22.294699 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e1d06e7b-e553-49bb-b86b-b04f8c7466f7 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:22.295427 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e1d06e7b-e553-49bb-b86b-b04f8c7466f7 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:22.302483 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e1d06e7b-e553-49bb-b86b-b04f8c7466f7 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:22.305442 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e1d06e7b-e553-49bb-b86b-b04f8c7466f7 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:22.305442 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e1d06e7b-e553-49bb-b86b-b04f8c7466f7 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:22.305442 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e1d06e7b-e553-49bb-b86b-b04f8c7466f7 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:22.367510 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-e1d06e7b-e553-49bb-b86b-b04f8c7466f7 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:22.376971 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e1d06e7b-e553-49bb-b86b-b04f8c7466f7 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1186 microversion: 2.1 time: 0.086360 Jun 22 10:34:22.379944 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 610/1235] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:22 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:23.393796 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3e2e512a-1d40-4a78-ae45-24418f23c7a4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:23.394352 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3e2e512a-1d40-4a78-ae45-24418f23c7a4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:23.402034 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3e2e512a-1d40-4a78-ae45-24418f23c7a4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:23.402483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3e2e512a-1d40-4a78-ae45-24418f23c7a4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:23.403253 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3e2e512a-1d40-4a78-ae45-24418f23c7a4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:23.403683 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3e2e512a-1d40-4a78-ae45-24418f23c7a4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:23.635601 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3e2e512a-1d40-4a78-ae45-24418f23c7a4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:23.643755 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3e2e512a-1d40-4a78-ae45-24418f23c7a4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1271 microversion: 2.1 time: 0.253687 Jun 22 10:34:23.644381 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 626/1236] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:23 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:34:24.662945 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-67e52e4d-2cec-44db-bb31-4559f1fdffa9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:24.664159 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-67e52e4d-2cec-44db-bb31-4559f1fdffa9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:24.670955 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-67e52e4d-2cec-44db-bb31-4559f1fdffa9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:24.671403 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-67e52e4d-2cec-44db-bb31-4559f1fdffa9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:24.672169 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-67e52e4d-2cec-44db-bb31-4559f1fdffa9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:24.672598 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-67e52e4d-2cec-44db-bb31-4559f1fdffa9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:24.805231 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-60833171-d1c3-4c90-88c1-213e1d3a09e0 req-8e623205-152f-4634-8d36-fce79e04bc08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b3084b-c1c8-472b-bc95-43167a9de848", "tag": "749b4a33-ce57-4dcc-ab58-cde5de4374a7"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:34:24.813948 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-60833171-d1c3-4c90-88c1-213e1d3a09e0 req-8e623205-152f-4634-8d36-fce79e04bc08 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:24.814528 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-60833171-d1c3-4c90-88c1-213e1d3a09e0 req-8e623205-152f-4634-8d36-fce79e04bc08 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:24.828460 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-60833171-d1c3-4c90-88c1-213e1d3a09e0 req-8e623205-152f-4634-8d36-fce79e04bc08 service nova] Creating event network-changed:749b4a33-ce57-4dcc-ab58-cde5de4374a7 for instance 92b3084b-c1c8-472b-bc95-43167a9de848 on hv-cinder-84327 Jun 22 10:34:24.833996 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-60833171-d1c3-4c90-88c1-213e1d3a09e0 req-8e623205-152f-4634-8d36-fce79e04bc08 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033099 Jun 22 10:34:24.835298 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 627/1237] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:34:24.908467 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-67e52e4d-2cec-44db-bb31-4559f1fdffa9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:24.920918 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-67e52e4d-2cec-44db-bb31-4559f1fdffa9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1259 microversion: 2.1 time: 0.259220 Jun 22 10:34:24.920918 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 611/1238] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:24 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:25.937232 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6c0367c8-e0ad-4a17-a0da-a8c18710be41 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:25.937933 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6c0367c8-e0ad-4a17-a0da-a8c18710be41 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:25.945331 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c0367c8-e0ad-4a17-a0da-a8c18710be41 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:25.945781 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c0367c8-e0ad-4a17-a0da-a8c18710be41 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:25.946560 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c0367c8-e0ad-4a17-a0da-a8c18710be41 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:25.947000 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c0367c8-e0ad-4a17-a0da-a8c18710be41 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:26.079379 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6c0367c8-e0ad-4a17-a0da-a8c18710be41 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:26.087188 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6c0367c8-e0ad-4a17-a0da-a8c18710be41 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1259 microversion: 2.1 time: 0.155975 Jun 22 10:34:26.087751 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 628/1239] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:25 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:34:27.104424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-fee01062-8467-4dc1-a9a3-b4bc1aea85e0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:27.105108 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-fee01062-8467-4dc1-a9a3-b4bc1aea85e0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:27.111596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fee01062-8467-4dc1-a9a3-b4bc1aea85e0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:27.112045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fee01062-8467-4dc1-a9a3-b4bc1aea85e0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:27.112803 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fee01062-8467-4dc1-a9a3-b4bc1aea85e0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:27.113263 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-fee01062-8467-4dc1-a9a3-b4bc1aea85e0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:27.248125 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-fee01062-8467-4dc1-a9a3-b4bc1aea85e0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:27.256566 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-fee01062-8467-4dc1-a9a3-b4bc1aea85e0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1259 microversion: 2.1 time: 0.155895 Jun 22 10:34:27.257170 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 612/1240] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:27 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:28.273289 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-0a67fea1-98dd-4781-8da2-44f33942b193 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:28.273910 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-0a67fea1-98dd-4781-8da2-44f33942b193 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:28.280371 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0a67fea1-98dd-4781-8da2-44f33942b193 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:28.280835 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0a67fea1-98dd-4781-8da2-44f33942b193 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:28.281604 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0a67fea1-98dd-4781-8da2-44f33942b193 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:28.282040 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-0a67fea1-98dd-4781-8da2-44f33942b193 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:28.410953 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-0a67fea1-98dd-4781-8da2-44f33942b193 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:28.418879 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-0a67fea1-98dd-4781-8da2-44f33942b193 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1259 microversion: 2.1 time: 0.149700 Jun 22 10:34:28.419433 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 629/1241] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:28 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:34:29.435577 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-52b5733f-a266-40bc-8e0e-1ba172581433 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:29.436206 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-52b5733f-a266-40bc-8e0e-1ba172581433 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:29.442871 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-52b5733f-a266-40bc-8e0e-1ba172581433 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:29.443315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-52b5733f-a266-40bc-8e0e-1ba172581433 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:29.444608 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-52b5733f-a266-40bc-8e0e-1ba172581433 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:29.445079 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-52b5733f-a266-40bc-8e0e-1ba172581433 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:29.578936 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-52b5733f-a266-40bc-8e0e-1ba172581433 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:29.586451 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-52b5733f-a266-40bc-8e0e-1ba172581433 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1259 microversion: 2.1 time: 0.154855 Jun 22 10:34:29.587010 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 613/1242] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:29 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:30.603620 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-422076c4-caab-4ad7-be0b-964d86df043d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:30.604235 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-422076c4-caab-4ad7-be0b-964d86df043d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:30.606777 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:30.611694 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-422076c4-caab-4ad7-be0b-964d86df043d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:30.612148 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-422076c4-caab-4ad7-be0b-964d86df043d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:30.613021 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-422076c4-caab-4ad7-be0b-964d86df043d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:30.613460 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-422076c4-caab-4ad7-be0b-964d86df043d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:30.755576 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-422076c4-caab-4ad7-be0b-964d86df043d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:30.763912 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-422076c4-caab-4ad7-be0b-964d86df043d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1259 microversion: 2.1 time: 0.164907 Jun 22 10:34:30.764428 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 630/1243] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:30 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:31.781350 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8b840cb1-456a-44a2-9f60-9de27cb1dff2 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:31.781966 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8b840cb1-456a-44a2-9f60-9de27cb1dff2 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:31.783867 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:31.789785 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8b840cb1-456a-44a2-9f60-9de27cb1dff2 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:31.790233 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8b840cb1-456a-44a2-9f60-9de27cb1dff2 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:31.790994 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8b840cb1-456a-44a2-9f60-9de27cb1dff2 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:31.791424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8b840cb1-456a-44a2-9f60-9de27cb1dff2 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:31.925130 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8b840cb1-456a-44a2-9f60-9de27cb1dff2 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:31.932670 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8b840cb1-456a-44a2-9f60-9de27cb1dff2 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1259 microversion: 2.1 time: 0.155195 Jun 22 10:34:31.933261 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 614/1244] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:31 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:32.949837 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c05a39b6-fcc1-4cee-9c5c-b7d07d5318a8 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:32.950465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c05a39b6-fcc1-4cee-9c5c-b7d07d5318a8 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:32.952493 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=8 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:32.958162 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c05a39b6-fcc1-4cee-9c5c-b7d07d5318a8 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:32.958609 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c05a39b6-fcc1-4cee-9c5c-b7d07d5318a8 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:32.959385 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c05a39b6-fcc1-4cee-9c5c-b7d07d5318a8 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:32.959840 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c05a39b6-fcc1-4cee-9c5c-b7d07d5318a8 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:33.094768 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c05a39b6-fcc1-4cee-9c5c-b7d07d5318a8 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:33.102733 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c05a39b6-fcc1-4cee-9c5c-b7d07d5318a8 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1259 microversion: 2.1 time: 0.156897 Jun 22 10:34:33.103302 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 631/1245] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:32 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:34.119989 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-812041eb-8620-4280-8c82-29898bc74b02 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:34.120545 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-812041eb-8620-4280-8c82-29898bc74b02 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:34.127005 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-812041eb-8620-4280-8c82-29898bc74b02 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:34.127458 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-812041eb-8620-4280-8c82-29898bc74b02 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:34.128227 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-812041eb-8620-4280-8c82-29898bc74b02 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:34.128665 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-812041eb-8620-4280-8c82-29898bc74b02 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:34.261684 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-812041eb-8620-4280-8c82-29898bc74b02 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:34.269132 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-812041eb-8620-4280-8c82-29898bc74b02 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1259 microversion: 2.1 time: 0.153579 Jun 22 10:34:34.269965 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 615/1246] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:34 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:35.285825 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-92609cee-f666-4ddd-bf4e-04fa0a28a0ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:35.286436 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-92609cee-f666-4ddd-bf4e-04fa0a28a0ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:35.292728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-92609cee-f666-4ddd-bf4e-04fa0a28a0ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:35.293224 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-92609cee-f666-4ddd-bf4e-04fa0a28a0ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:35.293994 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-92609cee-f666-4ddd-bf4e-04fa0a28a0ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:35.294431 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-92609cee-f666-4ddd-bf4e-04fa0a28a0ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:35.437547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-92609cee-f666-4ddd-bf4e-04fa0a28a0ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:35.445586 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-92609cee-f666-4ddd-bf4e-04fa0a28a0ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1259 microversion: 2.1 time: 0.163695 Jun 22 10:34:35.446181 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 632/1247] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:35 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:35.488141 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-8c4d30e8-560b-4be9-9e0b-498f15dab99e req-0698208c-1e62-404e-a420-8f9a50fa1fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b3084b-c1c8-472b-bc95-43167a9de848", "name": "network-vif-plugged", "status": "completed", "tag": "749b4a33-ce57-4dcc-ab58-cde5de4374a7"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:34:35.496539 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-8c4d30e8-560b-4be9-9e0b-498f15dab99e req-0698208c-1e62-404e-a420-8f9a50fa1fc9 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:35.497017 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-8c4d30e8-560b-4be9-9e0b-498f15dab99e req-0698208c-1e62-404e-a420-8f9a50fa1fc9 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:35.508502 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-8c4d30e8-560b-4be9-9e0b-498f15dab99e req-0698208c-1e62-404e-a420-8f9a50fa1fc9 service nova] Creating event network-vif-plugged:749b4a33-ce57-4dcc-ab58-cde5de4374a7 for instance 92b3084b-c1c8-472b-bc95-43167a9de848 on hv-cinder-84327 Jun 22 10:34:35.513872 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-8c4d30e8-560b-4be9-9e0b-498f15dab99e req-0698208c-1e62-404e-a420-8f9a50fa1fc9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029408 Jun 22 10:34:35.514457 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 616/1248] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:34:36.463004 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-eb21a0eb-cd84-4e7d-b65d-3b3e5d5a148f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:36.463531 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-eb21a0eb-cd84-4e7d-b65d-3b3e5d5a148f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:36.469899 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-eb21a0eb-cd84-4e7d-b65d-3b3e5d5a148f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:36.470350 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-eb21a0eb-cd84-4e7d-b65d-3b3e5d5a148f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:36.471092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-eb21a0eb-cd84-4e7d-b65d-3b3e5d5a148f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:36.471522 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-eb21a0eb-cd84-4e7d-b65d-3b3e5d5a148f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:36.601702 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-eb21a0eb-cd84-4e7d-b65d-3b3e5d5a148f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:36.609086 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-eb21a0eb-cd84-4e7d-b65d-3b3e5d5a148f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1259 microversion: 2.1 time: 0.150532 Jun 22 10:34:36.609650 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 633/1249] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:36 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:37.625544 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-77364834-dd4d-4d5e-8de7-1b6767468ac1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:37.626236 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-77364834-dd4d-4d5e-8de7-1b6767468ac1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:37.632847 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77364834-dd4d-4d5e-8de7-1b6767468ac1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:37.633310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77364834-dd4d-4d5e-8de7-1b6767468ac1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:37.634061 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77364834-dd4d-4d5e-8de7-1b6767468ac1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:37.634489 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-77364834-dd4d-4d5e-8de7-1b6767468ac1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:37.779905 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-77364834-dd4d-4d5e-8de7-1b6767468ac1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:37.788172 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-77364834-dd4d-4d5e-8de7-1b6767468ac1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1443 microversion: 2.1 time: 0.166271 Jun 22 10:34:37.788697 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 617/1250] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:37 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1443 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:37.804559 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-46eb7156-94b1-4de1-8058-11d8fd5b5ef5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:37.805436 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-46eb7156-94b1-4de1-8058-11d8fd5b5ef5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:37.812378 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-46eb7156-94b1-4de1-8058-11d8fd5b5ef5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:37.812857 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-46eb7156-94b1-4de1-8058-11d8fd5b5ef5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:37.813635 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-46eb7156-94b1-4de1-8058-11d8fd5b5ef5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:37.814073 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-46eb7156-94b1-4de1-8058-11d8fd5b5ef5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:37.958521 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-46eb7156-94b1-4de1-8058-11d8fd5b5ef5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:37.966408 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-46eb7156-94b1-4de1-8058-11d8fd5b5ef5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1443 microversion: 2.1 time: 0.165911 Jun 22 10:34:37.966983 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 634/1251] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:37 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:39.937910 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-88e9b4d8-30ff-4ffb-a048-6d98157e2c63 req-85255038-22d7-47f3-925c-715810a64c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b3084b-c1c8-472b-bc95-43167a9de848", "tag": "749b4a33-ce57-4dcc-ab58-cde5de4374a7"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:34:39.946864 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-88e9b4d8-30ff-4ffb-a048-6d98157e2c63 req-85255038-22d7-47f3-925c-715810a64c3b service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:39.947310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-88e9b4d8-30ff-4ffb-a048-6d98157e2c63 req-85255038-22d7-47f3-925c-715810a64c3b service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:39.958319 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-88e9b4d8-30ff-4ffb-a048-6d98157e2c63 req-85255038-22d7-47f3-925c-715810a64c3b service nova] Creating event network-changed:749b4a33-ce57-4dcc-ab58-cde5de4374a7 for instance 92b3084b-c1c8-472b-bc95-43167a9de848 on hv-cinder-84327 Jun 22 10:34:39.963858 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-88e9b4d8-30ff-4ffb-a048-6d98157e2c63 req-85255038-22d7-47f3-925c-715810a64c3b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029652 Jun 22 10:34:39.964455 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 618/1252] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:34:45.955385 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d8716e82-381e-4893-98cf-2194fa009efa tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:45.956008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-d8716e82-381e-4893-98cf-2194fa009efa tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:45.964248 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8716e82-381e-4893-98cf-2194fa009efa tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:45.964887 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8716e82-381e-4893-98cf-2194fa009efa tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:45.965669 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8716e82-381e-4893-98cf-2194fa009efa tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:45.966207 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-d8716e82-381e-4893-98cf-2194fa009efa tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:45.990691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d8716e82-381e-4893-98cf-2194fa009efa tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7/ips" status: 200 len: 150 microversion: 2.1 time: 0.041832 Jun 22 10:34:45.991268 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 635/1253] 10.222.0.46 () {58 vars in 1247 bytes} [Wed Jun 22 10:34:45 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:34:47.556438 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-18e63d16-b115-4c84-aee4-3f95ce09850d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf00d8aa-0483-4089-b7f5-490b954360d2"}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:34:47.557601 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-18e63d16-b115-4c84-aee4-3f95ce09850d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:47.563807 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-18e63d16-b115-4c84-aee4-3f95ce09850d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:47.564254 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-18e63d16-b115-4c84-aee4-3f95ce09850d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:47.565046 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-18e63d16-b115-4c84-aee4-3f95ce09850d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:47.565484 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-18e63d16-b115-4c84-aee4-3f95ce09850d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:48.429175 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-18e63d16-b115-4c84-aee4-3f95ce09850d tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "POST /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.877573 Jun 22 10:34:48.429781 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 619/1254] 10.222.0.46 () {60 vars in 1322 bytes} [Wed Jun 22 10:34:47 2022] POST /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:34:56.036362 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7bcbe208-5b10-4cc6-ada7-47bbc3cfa967 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:56.039266 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7bcbe208-5b10-4cc6-ada7-47bbc3cfa967 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:56.039441 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:56.040042 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=56 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:56.044785 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7bcbe208-5b10-4cc6-ada7-47bbc3cfa967 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:56.045301 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7bcbe208-5b10-4cc6-ada7-47bbc3cfa967 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:56.046737 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7bcbe208-5b10-4cc6-ada7-47bbc3cfa967 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:56.047179 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7bcbe208-5b10-4cc6-ada7-47bbc3cfa967 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:56.133038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-7bcbe208-5b10-4cc6-ada7-47bbc3cfa967 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lazy-loading 'services' on Instance uuid 3a382416-0f8f-4dd3-8402-b095a9c19fc7 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:34:56.362483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7bcbe208-5b10-4cc6-ada7-47bbc3cfa967 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7/os-volume_attachments/cf00d8aa-0483-4089-b7f5-490b954360d2" status: 202 len: 0 microversion: 2.1 time: 0.330091 Jun 22 10:34:56.362988 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 636/1255] 10.222.0.46 () {58 vars in 1415 bytes} [Wed Jun 22 10:34:56 2022] DELETE /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7/os-volume_attachments/cf00d8aa-0483-4089-b7f5-490b954360d2 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:34:56.373552 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-2d4a3eec-5b27-4f57-a313-d72bfa156dc2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:56.374639 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-2d4a3eec-5b27-4f57-a313-d72bfa156dc2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:56.394617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=25 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:56.394617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d4a3eec-5b27-4f57-a313-d72bfa156dc2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:56.394617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d4a3eec-5b27-4f57-a313-d72bfa156dc2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:56.394617 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d4a3eec-5b27-4f57-a313-d72bfa156dc2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:56.395065 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-2d4a3eec-5b27-4f57-a313-d72bfa156dc2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:56.395065 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:56.414027 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-2d4a3eec-5b27-4f57-a313-d72bfa156dc2 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Jun 22 10:34:56.414592 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 620/1256] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:34:56 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:34:57.427300 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-896849a8-6020-49f8-b606-c3809cafd1d7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:57.428337 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-896849a8-6020-49f8-b606-c3809cafd1d7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:57.434532 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-896849a8-6020-49f8-b606-c3809cafd1d7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:57.434973 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-896849a8-6020-49f8-b606-c3809cafd1d7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:57.435790 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-896849a8-6020-49f8-b606-c3809cafd1d7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:57.436223 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-896849a8-6020-49f8-b606-c3809cafd1d7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:57.464278 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-896849a8-6020-49f8-b606-c3809cafd1d7 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041772 Jun 22 10:34:57.464857 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 637/1257] 10.222.0.46 () {58 vars in 1301 bytes} [Wed Jun 22 10:34:57 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:34:57.524621 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-e68bbf26-13d4-4af4-8e84-ae34912f488b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:57.525272 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e68bbf26-13d4-4af4-8e84-ae34912f488b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:57.533335 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e68bbf26-13d4-4af4-8e84-ae34912f488b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:57.533743 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e68bbf26-13d4-4af4-8e84-ae34912f488b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:57.534536 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e68bbf26-13d4-4af4-8e84-ae34912f488b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:57.535313 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-e68bbf26-13d4-4af4-8e84-ae34912f488b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:57.567815 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-e68bbf26-13d4-4af4-8e84-ae34912f488b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:34:57.848542 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-e68bbf26-13d4-4af4-8e84-ae34912f488b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 204 len: 0 microversion: 2.1 time: 0.328333 Jun 22 10:34:57.849377 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 621/1258] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:34:57 2022] DELETE /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:34:57.857558 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-47229824-f6a1-4d9b-9488-61b2eb0c4ccb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:57.858184 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-47229824-f6a1-4d9b-9488-61b2eb0c4ccb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:57.864708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-47229824-f6a1-4d9b-9488-61b2eb0c4ccb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:57.865204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-47229824-f6a1-4d9b-9488-61b2eb0c4ccb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:57.865966 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-47229824-f6a1-4d9b-9488-61b2eb0c4ccb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:57.866406 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-47229824-f6a1-4d9b-9488-61b2eb0c4ccb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:58.011898 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-47229824-f6a1-4d9b-9488-61b2eb0c4ccb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:58.020178 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-47229824-f6a1-4d9b-9488-61b2eb0c4ccb tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1683 microversion: 2.1 time: 0.166477 Jun 22 10:34:58.020759 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 638/1259] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:57 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:59.037862 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-91dd35a3-4036-4c57-9c08-0548e1955ee8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:59.038601 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-91dd35a3-4036-4c57-9c08-0548e1955ee8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:59.045434 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-91dd35a3-4036-4c57-9c08-0548e1955ee8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:59.045890 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-91dd35a3-4036-4c57-9c08-0548e1955ee8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:59.047149 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-91dd35a3-4036-4c57-9c08-0548e1955ee8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:59.047578 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-91dd35a3-4036-4c57-9c08-0548e1955ee8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:59.176844 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-91dd35a3-4036-4c57-9c08-0548e1955ee8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:59.184297 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-91dd35a3-4036-4c57-9c08-0548e1955ee8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1683 microversion: 2.1 time: 0.150762 Jun 22 10:34:59.184884 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 622/1260] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:59 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:00.202121 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1230dfbe-d91d-4487-afb4-704aa23e26e5 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:00.202754 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1230dfbe-d91d-4487-afb4-704aa23e26e5 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:00.209617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1230dfbe-d91d-4487-afb4-704aa23e26e5 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:00.210048 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1230dfbe-d91d-4487-afb4-704aa23e26e5 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:00.210839 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1230dfbe-d91d-4487-afb4-704aa23e26e5 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:00.211281 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-1230dfbe-d91d-4487-afb4-704aa23e26e5 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:00.350549 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1230dfbe-d91d-4487-afb4-704aa23e26e5 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:00.358387 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1230dfbe-d91d-4487-afb4-704aa23e26e5 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1683 microversion: 2.1 time: 0.160226 Jun 22 10:35:00.359568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 639/1261] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:00 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:00.725907 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-37b626d2-c869-4411-8868-db9ef93ba58d req-7b614806-0323-4563-9d1b-cb7b17fa3151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a382416-0f8f-4dd3-8402-b095a9c19fc7", "name": "network-vif-deleted", "tag": "112930e8-3db4-4a53-aafa-c574837adfb5"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:35:00.734737 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-37b626d2-c869-4411-8868-db9ef93ba58d req-7b614806-0323-4563-9d1b-cb7b17fa3151 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:00.736278 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-37b626d2-c869-4411-8868-db9ef93ba58d req-7b614806-0323-4563-9d1b-cb7b17fa3151 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:00.747579 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-37b626d2-c869-4411-8868-db9ef93ba58d req-7b614806-0323-4563-9d1b-cb7b17fa3151 service nova] Creating event network-vif-deleted:112930e8-3db4-4a53-aafa-c574837adfb5 for instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 on hv-cinder-84327 Jun 22 10:35:00.753779 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-37b626d2-c869-4411-8868-db9ef93ba58d req-7b614806-0323-4563-9d1b-cb7b17fa3151 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095791 Jun 22 10:35:00.754481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 623/1262] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:35:01.376166 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-006bd7f2-fc3b-4283-90b9-989aceb7c264 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:01.376779 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-006bd7f2-fc3b-4283-90b9-989aceb7c264 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:01.383442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-006bd7f2-fc3b-4283-90b9-989aceb7c264 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:01.383892 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-006bd7f2-fc3b-4283-90b9-989aceb7c264 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:01.384659 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-006bd7f2-fc3b-4283-90b9-989aceb7c264 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:01.385119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-006bd7f2-fc3b-4283-90b9-989aceb7c264 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:01.417743 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-006bd7f2-fc3b-4283-90b9-989aceb7c264 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:01.418203 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-006bd7f2-fc3b-4283-90b9-989aceb7c264 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:01.418681 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-006bd7f2-fc3b-4283-90b9-989aceb7c264 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lazy-loading 'fault' on Instance uuid 3a382416-0f8f-4dd3-8402-b095a9c19fc7 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:35:01.465574 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-006bd7f2-fc3b-4283-90b9-989aceb7c264 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '082ece6ea4244242a6ba99152572c80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347c4ccbcb464091b8254475babf2874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:01.473344 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-006bd7f2-fc3b-4283-90b9-989aceb7c264 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 200 len: 1332 microversion: 2.1 time: 0.101577 Jun 22 10:35:01.473942 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 640/1263] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:01 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:02.492088 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-70c7d707-87ec-4845-8fa6-7c15e944b7f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:02.492692 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-70c7d707-87ec-4845-8fa6-7c15e944b7f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:02.498964 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-70c7d707-87ec-4845-8fa6-7c15e944b7f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:02.499409 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-70c7d707-87ec-4845-8fa6-7c15e944b7f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:02.500160 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-70c7d707-87ec-4845-8fa6-7c15e944b7f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:02.500591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-70c7d707-87ec-4845-8fa6-7c15e944b7f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:02.513596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-70c7d707-87ec-4845-8fa6-7c15e944b7f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-70c7d707-87ec-4845-8fa6-7c15e944b7f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 HTTP/1.1 Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:35:02.515220 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:35:02.517091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:35:02.517091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:02.517091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:02.517091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:02.517091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:02.517091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:35:02.517091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:35:02.517091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:35:02.517091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:02.517091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:35:02.517091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:02.517091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '3a382416-0f8f-4dd3-8402-b095a9c19fc7'} Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:35:02.518357 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:02.519992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:02.521498 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-70c7d707-87ec-4845-8fa6-7c15e944b7f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 404 to user: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:35:02.521498 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-70c7d707-87ec-4845-8fa6-7c15e944b7f6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 404 len: 111 microversion: 2.1 time: 0.029342 Jun 22 10:35:02.521498 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 624/1264] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:02 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:35:02.525727 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-d07d5861-8f78-4c6a-83d3-4cb8757d431b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '.version_select at 0x7f022c030790>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:02.603496 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-d07d5861-8f78-4c6a-83d3-4cb8757d431b tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724279974" status: 202 len: 0 microversion: 2.1 time: 0.081506 Jun 22 10:35:02.604092 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 641/1265] 10.222.0.46 () {58 vars in 1220 bytes} [Wed Jun 22 10:35:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724279974 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:35:04.744037 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-78124473-b6f5-41cc-ae1a-0ba07aab7e56 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:04.744534 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-78124473-b6f5-41cc-ae1a-0ba07aab7e56 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:04.751660 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-78124473-b6f5-41cc-ae1a-0ba07aab7e56 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:04.752100 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-78124473-b6f5-41cc-ae1a-0ba07aab7e56 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:04.752900 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-78124473-b6f5-41cc-ae1a-0ba07aab7e56 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:04.753333 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-78124473-b6f5-41cc-ae1a-0ba07aab7e56 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:04.767514 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-78124473-b6f5-41cc-ae1a-0ba07aab7e56 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-78124473-b6f5-41cc-ae1a-0ba07aab7e56 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: DELETE /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 HTTP/1.1 Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:35:04.769332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:35:04.770780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:35:04.770780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:04.770780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:04.770780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:04.770780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:04.770780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:35:04.770780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:35:04.770780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:35:04.770780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:04.770780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:35:04.770780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:04.770780 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '3a382416-0f8f-4dd3-8402-b095a9c19fc7'} Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:35:04.771591 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:04.773035 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:04.774721 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-78124473-b6f5-41cc-ae1a-0ba07aab7e56 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 404 to user: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:35:04.774721 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-78124473-b6f5-41cc-ae1a-0ba07aab7e56 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 404 len: 111 microversion: 2.1 time: 0.030499 Jun 22 10:35:04.774721 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 625/1266] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:35:04 2022] DELETE /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:35:04.780475 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5012ae1f-f2b8-44ac-b447-2305e31262e8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:04.781119 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5012ae1f-f2b8-44ac-b447-2305e31262e8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 3a382416-0f8f-4dd3-8402-b095a9c19fc7] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:04.788067 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5012ae1f-f2b8-44ac-b447-2305e31262e8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:04.789728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5012ae1f-f2b8-44ac-b447-2305e31262e8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:04.789728 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5012ae1f-f2b8-44ac-b447-2305e31262e8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:04.789931 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5012ae1f-f2b8-44ac-b447-2305e31262e8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:04.805245 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-5012ae1f-f2b8-44ac-b447-2305e31262e8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5012ae1f-f2b8-44ac-b447-2305e31262e8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 HTTP/1.1 Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:35:04.807008 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:35:04.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:35:04.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:04.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:04.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:04.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:04.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:35:04.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:35:04.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:35:04.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:04.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:35:04.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:04.809548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '3a382416-0f8f-4dd3-8402-b095a9c19fc7'} Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:35:04.811038 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. Jun 22 10:35:04.814041 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:04.815895 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5012ae1f-f2b8-44ac-b447-2305e31262e8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 404 to user: Instance 3a382416-0f8f-4dd3-8402-b095a9c19fc7 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:35:04.815895 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5012ae1f-f2b8-44ac-b447-2305e31262e8 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7" status: 404 len: 111 microversion: 2.1 time: 0.032204 Jun 22 10:35:04.815895 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 642/1267] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:04 2022] GET /compute/v2.1/servers/3a382416-0f8f-4dd3-8402-b095a9c19fc7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:35:06.100691 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-658c48c5-f19f-4821-9ed6-bf7a57483cc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:06.101311 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-658c48c5-f19f-4821-9ed6-bf7a57483cc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:06.108265 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-658c48c5-f19f-4821-9ed6-bf7a57483cc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:06.109388 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-658c48c5-f19f-4821-9ed6-bf7a57483cc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:06.110838 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-658c48c5-f19f-4821-9ed6-bf7a57483cc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:06.111286 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-658c48c5-f19f-4821-9ed6-bf7a57483cc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:06.127371 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-658c48c5-f19f-4821-9ed6-bf7a57483cc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-658c48c5-f19f-4821-9ed6-bf7a57483cc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: DELETE /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f HTTP/1.1 Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:35:06.128956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:35:06.130572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:35:06.130572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:06.130572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:06.130572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:06.130572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:06.130572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:35:06.130572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:35:06.130572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:35:06.130572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:06.130572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:35:06.130572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:35:06.130572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '38c28ffa-560d-4223-b5b1-a78ebd83201f'} Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:35:06.131424 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:35:06.133158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.135112 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-658c48c5-f19f-4821-9ed6-bf7a57483cc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 404 to user: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:35:06.135112 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-658c48c5-f19f-4821-9ed6-bf7a57483cc6 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 404 len: 111 microversion: 2.1 time: 0.033528 Jun 22 10:35:06.135112 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 626/1268] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:35:06 2022] DELETE /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:35:06.138856 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9eccecab-8955-42bc-ba6c-466d68c88b19 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:06.139483 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9eccecab-8955-42bc-ba6c-466d68c88b19 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 38c28ffa-560d-4223-b5b1-a78ebd83201f] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:06.146492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9eccecab-8955-42bc-ba6c-466d68c88b19 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:06.147010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9eccecab-8955-42bc-ba6c-466d68c88b19 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:06.147913 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9eccecab-8955-42bc-ba6c-466d68c88b19 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:06.148346 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9eccecab-8955-42bc-ba6c-466d68c88b19 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:06.163013 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-9eccecab-8955-42bc-ba6c-466d68c88b19 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9eccecab-8955-42bc-ba6c-466d68c88b19 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f HTTP/1.1 Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:35:06.164539 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:35:06.166204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:35:06.166204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:06.166204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:06.166204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:06.166204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:06.166204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:35:06.166204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:35:06.166204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:35:06.166204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:06.166204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:35:06.166204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:35:06.166204 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '38c28ffa-560d-4223-b5b1-a78ebd83201f'} Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:35:06.167180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. Jun 22 10:35:06.168760 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.170127 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9eccecab-8955-42bc-ba6c-466d68c88b19 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 404 to user: Instance 38c28ffa-560d-4223-b5b1-a78ebd83201f could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:35:06.170127 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9eccecab-8955-42bc-ba6c-466d68c88b19 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f" status: 404 len: 111 microversion: 2.1 time: 0.030957 Jun 22 10:35:06.170127 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 643/1269] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:06 2022] GET /compute/v2.1/servers/38c28ffa-560d-4223-b5b1-a78ebd83201f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:35:06.175055 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-434ad831-0c92-4f08-80f3-715d1c8a3216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:06.175553 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-434ad831-0c92-4f08-80f3-715d1c8a3216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:06.181895 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-434ad831-0c92-4f08-80f3-715d1c8a3216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:06.182345 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-434ad831-0c92-4f08-80f3-715d1c8a3216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:06.183105 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-434ad831-0c92-4f08-80f3-715d1c8a3216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:06.183541 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-434ad831-0c92-4f08-80f3-715d1c8a3216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:06.196966 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-434ad831-0c92-4f08-80f3-715d1c8a3216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-434ad831-0c92-4f08-80f3-715d1c8a3216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: DELETE /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 HTTP/1.1 Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:35:06.198521 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:35:06.200262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:35:06.200262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:06.200262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:06.200262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:06.200262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:06.200262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:35:06.200262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:35:06.200262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:35:06.200262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:06.200262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:35:06.200262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:35:06.200262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11'} Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:35:06.201280 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:35:06.203341 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.204933 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-434ad831-0c92-4f08-80f3-715d1c8a3216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 404 to user: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:35:06.204933 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-434ad831-0c92-4f08-80f3-715d1c8a3216 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 404 len: 111 microversion: 2.1 time: 0.029306 Jun 22 10:35:06.204933 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 627/1270] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:35:06 2022] DELETE /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:35:06.208381 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-476d8b6b-4383-48fb-943c-c7b774b7d619 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:06.209442 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-476d8b6b-4383-48fb-943c-c7b774b7d619 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:06.215524 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-476d8b6b-4383-48fb-943c-c7b774b7d619 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:06.216248 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-476d8b6b-4383-48fb-943c-c7b774b7d619 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:06.217055 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-476d8b6b-4383-48fb-943c-c7b774b7d619 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:06.217495 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-476d8b6b-4383-48fb-943c-c7b774b7d619 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:06.232416 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-476d8b6b-4383-48fb-943c-c7b774b7d619 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-476d8b6b-4383-48fb-943c-c7b774b7d619 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 HTTP/1.1 Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:35:06.234985 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:35:06.236778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:35:06.236778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:06.236778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:06.236778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:06.236778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:06.236778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:35:06.236778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:35:06.236778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:35:06.236778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:06.236778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:35:06.236778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:35:06.236778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11'} Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:35:06.237725 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. Jun 22 10:35:06.239051 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:06.240611 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-476d8b6b-4383-48fb-943c-c7b774b7d619 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 404 to user: Instance 7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:35:06.240611 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-476d8b6b-4383-48fb-943c-c7b774b7d619 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11" status: 404 len: 111 microversion: 2.1 time: 0.031805 Jun 22 10:35:06.240611 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 644/1271] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:06 2022] GET /compute/v2.1/servers/7bdc67c7-50e3-46e9-ad1c-6f6c75e55f11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:35:07.610506 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b5a3c050-989d-4670-a924-ac0d982f8d28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:07.611022 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b5a3c050-989d-4670-a924-ac0d982f8d28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:07.617631 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b5a3c050-989d-4670-a924-ac0d982f8d28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:07.618081 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b5a3c050-989d-4670-a924-ac0d982f8d28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:07.618849 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b5a3c050-989d-4670-a924-ac0d982f8d28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:07.619286 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b5a3c050-989d-4670-a924-ac0d982f8d28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:07.633084 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-b5a3c050-989d-4670-a924-ac0d982f8d28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b5a3c050-989d-4670-a924-ac0d982f8d28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: DELETE /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 HTTP/1.1 Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:35:07.634645 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:35:07.636309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:35:07.636309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:07.636309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:07.636309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:07.636309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:07.636309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:35:07.636309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:35:07.636309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:35:07.636309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:07.636309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:35:07.636309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:35:07.636309 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '95e62bb2-0dfd-4516-a97a-68aa18a98fe6'} Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:35:07.637217 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:35:07.638529 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:35:07.640448 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b5a3c050-989d-4670-a924-ac0d982f8d28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 404 to user: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:35:07.640448 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b5a3c050-989d-4670-a924-ac0d982f8d28 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "DELETE /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 404 len: 111 microversion: 2.1 time: 0.029562 Jun 22 10:35:07.640448 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 628/1272] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:35:07 2022] DELETE /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:35:07.645161 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f8c0126a-86a6-4cb9-b583-32b2fe8eeb66 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:07.645778 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f8c0126a-86a6-4cb9-b583-32b2fe8eeb66 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] [instance: 95e62bb2-0dfd-4516-a97a-68aa18a98fe6] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:07.652292 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f8c0126a-86a6-4cb9-b583-32b2fe8eeb66 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:07.652748 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f8c0126a-86a6-4cb9-b583-32b2fe8eeb66 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:07.653550 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f8c0126a-86a6-4cb9-b583-32b2fe8eeb66 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:07.653989 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f8c0126a-86a6-4cb9-b583-32b2fe8eeb66 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:07.667446 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-f8c0126a-86a6-4cb9-b583-32b2fe8eeb66 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] HTTP exception thrown: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f8c0126a-86a6-4cb9-b583-32b2fe8eeb66 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Request method failure captured: Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 HTTP/1.1 Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisu5RAeu_gSHWTFHZBYC1rXf8C8YZZ9_mjeljvGur9ljqclwOcKA6lIOxiVsXzZ6ylJineWJxTwZucfYYEwA0MsnumBxE0_7_ae8X4TGCJui65ZydTvu2bmNChDxF_N2lI1b6t9H3mBNd-lBqkID-8-P_rEooASnuhHl2JOwkM_-n6HI Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:35:07.669036 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:35:07.670878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_347c4ccbcb464091b8254475babf2874", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/347c4ccbcb464091b8254475babf2874"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:35:07.670878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:07.670878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 347c4ccbcb464091b8254475babf2874 Jun 22 10:35:07.670878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-286047092 Jun 22 10:35:07.670878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:07.670878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:35:07.670878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:35:07.670878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: 082ece6ea4244242a6ba99152572c80f Jun 22 10:35:07.670878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-AttachVolumeNegativeTest-286047092-project Jun 22 10:35:07.670878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:35:07.670878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:35:07.670878 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '95e62bb2-0dfd-4516-a97a-68aa18a98fe6'} Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:35:07.672010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. Jun 22 10:35:07.673617 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:35:07.675139 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f8c0126a-86a6-4cb9-b583-32b2fe8eeb66 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] Returning 404 to user: Instance 95e62bb2-0dfd-4516-a97a-68aa18a98fe6 could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:35:07.675139 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f8c0126a-86a6-4cb9-b583-32b2fe8eeb66 tempest-AttachVolumeNegativeTest-286047092 tempest-AttachVolumeNegativeTest-286047092-project] 10.222.0.46 "GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6" status: 404 len: 111 microversion: 2.1 time: 0.029312 Jun 22 10:35:07.675139 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 645/1273] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:07 2022] GET /compute/v2.1/servers/95e62bb2-0dfd-4516-a97a-68aa18a98fe6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:35:15.234533 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:35:15.235045 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Wed Jun 22 10:35:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:36:39.600108 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1593355504", "imageRef": "12847ae1-0d45-4bfe-b11c-92eb8d4918bf", "flavorRef": "452"}} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:36:39.605816 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:39.606465 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:39.653331 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.network.neutron [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] validate_networks() for None {{(pid=118326) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:36:39.988348 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Flavor limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:36:39.988775 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Image limits 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:36:39.989293 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Flavor pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:36:39.989919 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Image pref 0:0:0 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:36:39.990366 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.virt.hardware [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118326) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:36:39.999499 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:39.999962 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:40.000767 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:40.001238 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:40.018567 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Getting quotas for project 95ce4ff3b62f4bc0a7afc77dde603bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:36:40.023174 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.quota [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Getting quotas for user f67a7d7265ee4d4b84099a88cf9edfbd and project 95ce4ff3b62f4bc0a7afc77dde603bd0. Resources: {'instances', 'ram', 'cores'} {{(pid=118326) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:36:40.034252 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Going to run 1 instances... {{(pid=118326) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:36:40.036537 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12847ae1-0d45-4bfe-b11c-92eb8d4918bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118326) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:36:40.160803 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-05701892-fff8-43a4-ba0f-3664424519fe tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564932 Jun 22 10:36:40.166726 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 629/1274] 10.222.0.46 () {60 vars in 1146 bytes} [Wed Jun 22 10:36:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:36:40.173466 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:40.173466 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:40.174848 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-1e59a26a-4575-4093-a174-ff4f278357b5 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:40.175473 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-1e59a26a-4575-4093-a174-ff4f278357b5 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:40.245947 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-1e59a26a-4575-4093-a174-ff4f278357b5 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:40.254354 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-1e59a26a-4575-4093-a174-ff4f278357b5 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1215 microversion: 2.1 time: 0.086264 Jun 22 10:36:40.254928 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 646/1275] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:40 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:41.272358 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-54ff645d-0bfc-4fb3-a0f0-6ddedca93f5f tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:41.272983 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-54ff645d-0bfc-4fb3-a0f0-6ddedca93f5f tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:41.329080 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-54ff645d-0bfc-4fb3-a0f0-6ddedca93f5f tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:41.337108 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-54ff645d-0bfc-4fb3-a0f0-6ddedca93f5f tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1215 microversion: 2.1 time: 0.069379 Jun 22 10:36:41.337677 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 630/1276] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:41 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:42.366163 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-68c4e26f-56e6-46bc-b6b4-d8cc450ec076 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:42.366726 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-68c4e26f-56e6-46bc-b6b4-d8cc450ec076 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:42.374705 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-68c4e26f-56e6-46bc-b6b4-d8cc450ec076 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:42.375155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-68c4e26f-56e6-46bc-b6b4-d8cc450ec076 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:42.375924 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-68c4e26f-56e6-46bc-b6b4-d8cc450ec076 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:42.376366 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-68c4e26f-56e6-46bc-b6b4-d8cc450ec076 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:42.441649 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-68c4e26f-56e6-46bc-b6b4-d8cc450ec076 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:42.449698 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-68c4e26f-56e6-46bc-b6b4-d8cc450ec076 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1267 microversion: 2.1 time: 0.088209 Jun 22 10:36:42.450259 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 647/1277] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:42 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1267 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:43.467250 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9b6e3060-9c9d-4eb6-95ff-b7569cee3b94 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:43.467954 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9b6e3060-9c9d-4eb6-95ff-b7569cee3b94 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:43.474596 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b6e3060-9c9d-4eb6-95ff-b7569cee3b94 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:43.475109 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b6e3060-9c9d-4eb6-95ff-b7569cee3b94 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:43.475926 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b6e3060-9c9d-4eb6-95ff-b7569cee3b94 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:43.476296 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9b6e3060-9c9d-4eb6-95ff-b7569cee3b94 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:43.564524 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9b6e3060-9c9d-4eb6-95ff-b7569cee3b94 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:43.572541 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9b6e3060-9c9d-4eb6-95ff-b7569cee3b94 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1273 microversion: 2.1 time: 0.109193 Jun 22 10:36:43.573143 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 631/1278] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:43 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:44.589482 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-8fa06d66-efce-4104-9757-99929067c0ac tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:44.590210 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-8fa06d66-efce-4104-9757-99929067c0ac tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:44.597439 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8fa06d66-efce-4104-9757-99929067c0ac tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:44.597960 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8fa06d66-efce-4104-9757-99929067c0ac tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:44.598795 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8fa06d66-efce-4104-9757-99929067c0ac tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:44.599296 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-8fa06d66-efce-4104-9757-99929067c0ac tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:44.782359 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-8fa06d66-efce-4104-9757-99929067c0ac tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:44.790379 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-8fa06d66-efce-4104-9757-99929067c0ac tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1315 microversion: 2.1 time: 0.204839 Jun 22 10:36:44.790939 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 648/1279] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:44 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:36:45.191522 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-a79d5d92-77c7-4fff-bd12-6a2c275c4dd7 req-9fcb7b98-ca66-4f4b-a911-71fbbc2edb5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217a0570-1aa0-4d60-b5fd-efe43461f80d", "tag": "aded2b63-ab94-4107-b5ad-4772108dc780"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:36:45.200707 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-a79d5d92-77c7-4fff-bd12-6a2c275c4dd7 req-9fcb7b98-ca66-4f4b-a911-71fbbc2edb5d service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:45.201240 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-a79d5d92-77c7-4fff-bd12-6a2c275c4dd7 req-9fcb7b98-ca66-4f4b-a911-71fbbc2edb5d service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:45.212985 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-a79d5d92-77c7-4fff-bd12-6a2c275c4dd7 req-9fcb7b98-ca66-4f4b-a911-71fbbc2edb5d service nova] Creating event network-changed:aded2b63-ab94-4107-b5ad-4772108dc780 for instance 217a0570-1aa0-4d60-b5fd-efe43461f80d on hv-cinder-84327 Jun 22 10:36:45.220300 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-a79d5d92-77c7-4fff-bd12-6a2c275c4dd7 req-9fcb7b98-ca66-4f4b-a911-71fbbc2edb5d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031886 Jun 22 10:36:45.220300 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 632/1280] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:36:45.809149 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6c4ac315-623c-44e2-8977-5d615bdf8cd1 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:45.810170 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6c4ac315-623c-44e2-8977-5d615bdf8cd1 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:45.817621 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c4ac315-623c-44e2-8977-5d615bdf8cd1 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:45.823221 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c4ac315-623c-44e2-8977-5d615bdf8cd1 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:45.823221 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c4ac315-623c-44e2-8977-5d615bdf8cd1 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:45.823221 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6c4ac315-623c-44e2-8977-5d615bdf8cd1 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:45.969794 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6c4ac315-623c-44e2-8977-5d615bdf8cd1 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:45.978166 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6c4ac315-623c-44e2-8977-5d615bdf8cd1 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1315 microversion: 2.1 time: 0.174818 Jun 22 10:36:45.978738 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 649/1281] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:45 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:46.996490 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-1b2c8265-fb2b-484d-97f0-a66e3db91140 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:46.997196 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-1b2c8265-fb2b-484d-97f0-a66e3db91140 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:47.003430 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1b2c8265-fb2b-484d-97f0-a66e3db91140 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:47.003912 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1b2c8265-fb2b-484d-97f0-a66e3db91140 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:47.004681 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1b2c8265-fb2b-484d-97f0-a66e3db91140 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:47.005143 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-1b2c8265-fb2b-484d-97f0-a66e3db91140 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:47.133185 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-1b2c8265-fb2b-484d-97f0-a66e3db91140 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:47.140999 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-1b2c8265-fb2b-484d-97f0-a66e3db91140 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1315 microversion: 2.1 time: 0.149852 Jun 22 10:36:47.141563 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 633/1282] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:46 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:48.157638 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-e1e10c3f-2db3-4234-b49d-02e0d954992c tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:48.158246 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-e1e10c3f-2db3-4234-b49d-02e0d954992c tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:48.164668 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e1e10c3f-2db3-4234-b49d-02e0d954992c tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:48.165146 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e1e10c3f-2db3-4234-b49d-02e0d954992c tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:48.165905 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e1e10c3f-2db3-4234-b49d-02e0d954992c tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:48.166335 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-e1e10c3f-2db3-4234-b49d-02e0d954992c tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:48.297194 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-e1e10c3f-2db3-4234-b49d-02e0d954992c tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:48.305155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-e1e10c3f-2db3-4234-b49d-02e0d954992c tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1315 microversion: 2.1 time: 0.151383 Jun 22 10:36:48.305799 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 650/1283] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:48 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:49.322620 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8433c566-92b8-4752-b691-5b86f580859e tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:49.323261 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8433c566-92b8-4752-b691-5b86f580859e tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:49.329486 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8433c566-92b8-4752-b691-5b86f580859e tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:49.329939 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8433c566-92b8-4752-b691-5b86f580859e tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:49.330708 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8433c566-92b8-4752-b691-5b86f580859e tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:49.331140 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8433c566-92b8-4752-b691-5b86f580859e tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:49.461327 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8433c566-92b8-4752-b691-5b86f580859e tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:49.468749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8433c566-92b8-4752-b691-5b86f580859e tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1315 microversion: 2.1 time: 0.150640 Jun 22 10:36:49.469342 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 634/1284] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:49 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:50.485308 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-f49fbf6a-6d0b-436b-bad7-e4e39e1a2deb tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:50.486011 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-f49fbf6a-6d0b-436b-bad7-e4e39e1a2deb tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:50.488278 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell0:SELECT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:50.493628 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f49fbf6a-6d0b-436b-bad7-e4e39e1a2deb tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:50.494073 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f49fbf6a-6d0b-436b-bad7-e4e39e1a2deb tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:50.494828 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f49fbf6a-6d0b-436b-bad7-e4e39e1a2deb tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:50.495262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-f49fbf6a-6d0b-436b-bad7-e4e39e1a2deb tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:50.633926 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-f49fbf6a-6d0b-436b-bad7-e4e39e1a2deb tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:50.641907 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-f49fbf6a-6d0b-436b-bad7-e4e39e1a2deb tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1315 microversion: 2.1 time: 0.160410 Jun 22 10:36:50.642480 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 651/1285] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:50 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:51.657704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3a1876e5-44e7-4bc7-b65f-5170cd49b799 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:51.658310 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3a1876e5-44e7-4bc7-b65f-5170cd49b799 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:51.660234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=2 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:51.661423 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell0:SELECT=8 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:51.666261 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3a1876e5-44e7-4bc7-b65f-5170cd49b799 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:51.666703 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3a1876e5-44e7-4bc7-b65f-5170cd49b799 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:51.667631 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3a1876e5-44e7-4bc7-b65f-5170cd49b799 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:51.668491 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3a1876e5-44e7-4bc7-b65f-5170cd49b799 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:51.799453 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3a1876e5-44e7-4bc7-b65f-5170cd49b799 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:51.807483 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3a1876e5-44e7-4bc7-b65f-5170cd49b799 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1315 microversion: 2.1 time: 0.153670 Jun 22 10:36:51.809581 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 635/1286] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:51 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:52.168351 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:36:52.169105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Wed Jun 22 10:36:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.46) !!! Jun 22 10:36:52.264906 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-84b920c5-7909-4a90-99d8-f02efdd60bd1 req-43e18ed3-fcc6-47b0-ba3b-e868c2eedc43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217a0570-1aa0-4d60-b5fd-efe43461f80d", "name": "network-vif-plugged", "status": "completed", "tag": "aded2b63-ab94-4107-b5ad-4772108dc780"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:36:52.273613 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-84b920c5-7909-4a90-99d8-f02efdd60bd1 req-43e18ed3-fcc6-47b0-ba3b-e868c2eedc43 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:52.274069 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-84b920c5-7909-4a90-99d8-f02efdd60bd1 req-43e18ed3-fcc6-47b0-ba3b-e868c2eedc43 service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:52.286307 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-84b920c5-7909-4a90-99d8-f02efdd60bd1 req-43e18ed3-fcc6-47b0-ba3b-e868c2eedc43 service nova] Creating event network-vif-plugged:aded2b63-ab94-4107-b5ad-4772108dc780 for instance 217a0570-1aa0-4d60-b5fd-efe43461f80d on hv-cinder-84327 Jun 22 10:36:52.291399 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-84b920c5-7909-4a90-99d8-f02efdd60bd1 req-43e18ed3-fcc6-47b0-ba3b-e868c2eedc43 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149571 Jun 22 10:36:52.291994 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 652/1287] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:36:52.826034 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-01803ec2-be82-4139-a912-74b76b892469 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:52.826671 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-01803ec2-be82-4139-a912-74b76b892469 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:52.833459 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-01803ec2-be82-4139-a912-74b76b892469 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:52.833907 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-01803ec2-be82-4139-a912-74b76b892469 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:52.834723 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-01803ec2-be82-4139-a912-74b76b892469 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:52.835159 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-01803ec2-be82-4139-a912-74b76b892469 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:52.962875 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-01803ec2-be82-4139-a912-74b76b892469 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:52.970572 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-01803ec2-be82-4139-a912-74b76b892469 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1315 microversion: 2.1 time: 0.149584 Jun 22 10:36:52.971222 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 636/1288] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:52 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:53.988618 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6534e598-1384-4525-9ebb-0d727d2b5776 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:53.989271 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6534e598-1384-4525-9ebb-0d727d2b5776 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:53.995470 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6534e598-1384-4525-9ebb-0d727d2b5776 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:53.995925 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6534e598-1384-4525-9ebb-0d727d2b5776 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:53.996684 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6534e598-1384-4525-9ebb-0d727d2b5776 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:53.997145 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6534e598-1384-4525-9ebb-0d727d2b5776 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:54.126181 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6534e598-1384-4525-9ebb-0d727d2b5776 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:54.134191 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6534e598-1384-4525-9ebb-0d727d2b5776 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1315 microversion: 2.1 time: 0.150410 Jun 22 10:36:54.134756 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 653/1289] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:53 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:55.150883 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-3b00ad88-cedd-4176-90ab-7a1d19bac7a2 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:55.151539 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-3b00ad88-cedd-4176-90ab-7a1d19bac7a2 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:55.158351 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3b00ad88-cedd-4176-90ab-7a1d19bac7a2 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:55.158804 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3b00ad88-cedd-4176-90ab-7a1d19bac7a2 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:55.159580 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3b00ad88-cedd-4176-90ab-7a1d19bac7a2 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:55.160018 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-3b00ad88-cedd-4176-90ab-7a1d19bac7a2 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:55.294452 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-3b00ad88-cedd-4176-90ab-7a1d19bac7a2 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:55.302091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-3b00ad88-cedd-4176-90ab-7a1d19bac7a2 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1465 microversion: 2.1 time: 0.155131 Jun 22 10:36:55.302657 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 637/1290] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:55 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1465 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:55.346241 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5427f193-951b-415a-828e-9e1feaf66247 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:55.354014 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5427f193-951b-415a-828e-9e1feaf66247 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:55.357400 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5427f193-951b-415a-828e-9e1feaf66247 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:55.357962 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5427f193-951b-415a-828e-9e1feaf66247 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:55.358688 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5427f193-951b-415a-828e-9e1feaf66247 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:55.359745 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5427f193-951b-415a-828e-9e1feaf66247 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:55.386593 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5427f193-951b-415a-828e-9e1feaf66247 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Going to try to terminate instance {{(pid=118327) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:36:55.688747 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5427f193-951b-415a-828e-9e1feaf66247 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "DELETE /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 204 len: 0 microversion: 2.1 time: 0.349878 Jun 22 10:36:55.689415 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 654/1291] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:36:55 2022] DELETE /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:36:55.698241 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-788c764d-89d7-4484-8fa6-383532c74974 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:55.698854 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-788c764d-89d7-4484-8fa6-383532c74974 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:55.704956 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-788c764d-89d7-4484-8fa6-383532c74974 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:55.705404 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-788c764d-89d7-4484-8fa6-383532c74974 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:55.706165 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-788c764d-89d7-4484-8fa6-383532c74974 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:55.706600 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-788c764d-89d7-4484-8fa6-383532c74974 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:55.836598 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-788c764d-89d7-4484-8fa6-383532c74974 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:55.844625 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-788c764d-89d7-4484-8fa6-383532c74974 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1471 microversion: 2.1 time: 0.150816 Jun 22 10:36:55.845249 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 638/1292] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:55 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:56.136228 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:36:56.136468 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Wed Jun 22 10:36:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:36:56.862509 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7c4eba9f-073a-4f24-a361-e5d8612b87ea tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:56.863202 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7c4eba9f-073a-4f24-a361-e5d8612b87ea tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:56.870308 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7c4eba9f-073a-4f24-a361-e5d8612b87ea tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:56.870752 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7c4eba9f-073a-4f24-a361-e5d8612b87ea tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:56.871510 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7c4eba9f-073a-4f24-a361-e5d8612b87ea tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:56.871941 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7c4eba9f-073a-4f24-a361-e5d8612b87ea tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:57.028584 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7c4eba9f-073a-4f24-a361-e5d8612b87ea tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:57.037237 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7c4eba9f-073a-4f24-a361-e5d8612b87ea tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1471 microversion: 2.1 time: 0.179015 Jun 22 10:36:57.037813 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 655/1293] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:56 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:57.715015 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-f03fb6ba-ee02-42d7-b6c6-6c94d89b3aa0 req-fe0b80b3-5aa2-41cf-96c5-fcf1d52e38df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217a0570-1aa0-4d60-b5fd-efe43461f80d", "name": "network-vif-deleted", "tag": "aded2b63-ab94-4107-b5ad-4772108dc780"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:36:57.723586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-f03fb6ba-ee02-42d7-b6c6-6c94d89b3aa0 req-fe0b80b3-5aa2-41cf-96c5-fcf1d52e38df service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:57.724031 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-f03fb6ba-ee02-42d7-b6c6-6c94d89b3aa0 req-fe0b80b3-5aa2-41cf-96c5-fcf1d52e38df service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:57.736121 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-f03fb6ba-ee02-42d7-b6c6-6c94d89b3aa0 req-fe0b80b3-5aa2-41cf-96c5-fcf1d52e38df service nova] Creating event network-vif-deleted:aded2b63-ab94-4107-b5ad-4772108dc780 for instance 217a0570-1aa0-4d60-b5fd-efe43461f80d on hv-cinder-84327 Jun 22 10:36:57.741328 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-f03fb6ba-ee02-42d7-b6c6-6c94d89b3aa0 req-fe0b80b3-5aa2-41cf-96c5-fcf1d52e38df service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030066 Jun 22 10:36:57.746155 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 639/1294] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:36:58.018463 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a9d00d06-1228-4a61-95af-b38d13809331 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:36:58.019157 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a9d00d06-1228-4a61-95af-b38d13809331 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:58.026186 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a9d00d06-1228-4a61-95af-b38d13809331 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:58.034348 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a9d00d06-1228-4a61-95af-b38d13809331 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:58.034348 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a9d00d06-1228-4a61-95af-b38d13809331 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:58.034348 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a9d00d06-1228-4a61-95af-b38d13809331 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:58.053276 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-a9d00d06-1228-4a61-95af-b38d13809331 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lazy-loading 'flavor' on Instance uuid 92b3084b-c1c8-472b-bc95-43167a9de848 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:36:58.056419 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b290d39c-93aa-45e3-908b-c56daf022dfa tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:58.057642 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b290d39c-93aa-45e3-908b-c56daf022dfa tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:58.064565 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b290d39c-93aa-45e3-908b-c56daf022dfa tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:58.065047 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b290d39c-93aa-45e3-908b-c56daf022dfa tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:58.065818 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b290d39c-93aa-45e3-908b-c56daf022dfa tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:58.066249 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b290d39c-93aa-45e3-908b-c56daf022dfa tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:58.098234 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b290d39c-93aa-45e3-908b-c56daf022dfa tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:58.098674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b290d39c-93aa-45e3-908b-c56daf022dfa tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:58.099113 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.objects.instance [None req-b290d39c-93aa-45e3-908b-c56daf022dfa tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lazy-loading 'fault' on Instance uuid 217a0570-1aa0-4d60-b5fd-efe43461f80d {{(pid=118326) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:36:58.141080 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-b290d39c-93aa-45e3-908b-c56daf022dfa tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67a7d7265ee4d4b84099a88cf9edfbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ce4ff3b62f4bc0a7afc77dde603bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:58.149192 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b290d39c-93aa-45e3-908b-c56daf022dfa tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 200 len: 1305 microversion: 2.1 time: 0.097263 Jun 22 10:36:58.154651 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 640/1295] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:58 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:36:58.356188 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a9d00d06-1228-4a61-95af-b38d13809331 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "POST /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848/action" status: 202 len: 0 microversion: 2.1 time: 0.341702 Jun 22 10:36:58.356942 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 656/1296] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:36:58 2022] POST /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:36:58.365200 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a68f576e-f2d9-4690-81fa-0ea1c8558e06 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:58.365808 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a68f576e-f2d9-4690-81fa-0ea1c8558e06 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:58.380298 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a68f576e-f2d9-4690-81fa-0ea1c8558e06 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:58.383070 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a68f576e-f2d9-4690-81fa-0ea1c8558e06 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:58.383070 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a68f576e-f2d9-4690-81fa-0ea1c8558e06 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:58.383070 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a68f576e-f2d9-4690-81fa-0ea1c8558e06 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:58.525526 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a68f576e-f2d9-4690-81fa-0ea1c8558e06 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:58.533064 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a68f576e-f2d9-4690-81fa-0ea1c8558e06 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.172034 Jun 22 10:36:58.537710 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 641/1297] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:58 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:59.167686 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c9ad3da5-95c7-4d76-9e56-5db3c58a6b80 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:59.168383 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c9ad3da5-95c7-4d76-9e56-5db3c58a6b80 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] [instance: 217a0570-1aa0-4d60-b5fd-efe43461f80d] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:59.174731 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c9ad3da5-95c7-4d76-9e56-5db3c58a6b80 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:59.175262 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c9ad3da5-95c7-4d76-9e56-5db3c58a6b80 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:59.176019 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c9ad3da5-95c7-4d76-9e56-5db3c58a6b80 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:59.176457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c9ad3da5-95c7-4d76-9e56-5db3c58a6b80 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:59.193007 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.wsgi [None req-c9ad3da5-95c7-4d76-9e56-5db3c58a6b80 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] HTTP exception thrown: Instance 217a0570-1aa0-4d60-b5fd-efe43461f80d could not be found. Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c9ad3da5-95c7-4d76-9e56-5db3c58a6b80 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Request method failure captured: Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: request: GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d HTTP/1.1 Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept: application/json Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Accept-Encoding: identity Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Connection: close Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Length: 0 Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Content-Type: application/json Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Host: 10.222.0.46 Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Openstack-System-Scope: None Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: User-Agent: python-urllib3/1.26.9 Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Auth-Token: gAAAAABisvC1LWYF7orJs6lTgb3l8FEpvyEo-PsgoERUWZoUVTY_x5LAA6WhZ5Yg1yMXOysyVSN4M3evFL1fkbhkzpZSkbUUdBhTcMsG0vjxT9evHODx5fOgyOvq6j0uSONUtkQnjTG5qCgEAqYOCd_zRiJyOPLFB2tKpHlqDNQ42Llx6Tf-nfg Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Id: None Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Domain-Name: None Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Identity-Status: Confirmed Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Is-Admin-Project: True Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Id: default Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Domain-Name: Default Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Id: 95ce4ff3b62f4bc0a7afc77dde603bd0 Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Project-Name: tempest-VolumesNegativeTest-1934558009 Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Role: member,reader Jun 22 10:36:59.194691 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Roles: member,reader Jun 22 10:36:59.196880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95ce4ff3b62f4bc0a7afc77dde603bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_95ce4ff3b62f4bc0a7afc77dde603bd0", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/95ce4ff3b62f4bc0a7afc77dde603bd0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/95ce4ff3b62f4bc0a7afc77dde603bd0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:36:59.196880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant: tempest-VolumesNegativeTest-1934558009 Jun 22 10:36:59.196880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Id: 95ce4ff3b62f4bc0a7afc77dde603bd0 Jun 22 10:36:59.196880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-Tenant-Name: tempest-VolumesNegativeTest-1934558009 Jun 22 10:36:59.196880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User: tempest-VolumesNegativeTest-1934558009-project Jun 22 10:36:59.196880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Id: default Jun 22 10:36:59.196880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Domain-Name: Default Jun 22 10:36:59.196880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Id: f67a7d7265ee4d4b84099a88cf9edfbd Jun 22 10:36:59.196880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: X-User-Name: tempest-VolumesNegativeTest-1934558009-project Jun 22 10:36:59.196880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: method: > Jun 22 10:36:59.196880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: exception: Instance 217a0570-1aa0-4d60-b5fd-efe43461f80d could not be found. Jun 22 10:36:59.196880 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: action_args: {'id': '217a0570-1aa0-4d60-b5fd-efe43461f80d'} Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 217a0570-1aa0-4d60-b5fd-efe43461f80d could not be found. Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:36:59.197783 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 217a0570-1aa0-4d60-b5fd-efe43461f80d could not be found. Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 217a0570-1aa0-4d60-b5fd-efe43461f80d could not be found. Jun 22 10:36:59.199534 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR nova.api.openstack.wsgi Jun 22 10:36:59.201117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c9ad3da5-95c7-4d76-9e56-5db3c58a6b80 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] Returning 404 to user: Instance 217a0570-1aa0-4d60-b5fd-efe43461f80d could not be found. {{(pid=118327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:36:59.201117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c9ad3da5-95c7-4d76-9e56-5db3c58a6b80 tempest-VolumesNegativeTest-1934558009 tempest-VolumesNegativeTest-1934558009-project] 10.222.0.46 "GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d" status: 404 len: 111 microversion: 2.1 time: 0.033586 Jun 22 10:36:59.201117 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 657/1298] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:59 2022] GET /compute/v2.1/servers/217a0570-1aa0-4d60-b5fd-efe43461f80d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:36:59.551149 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-06fc013b-93b9-4c4e-a069-67053aeb3cc9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:59.557036 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-06fc013b-93b9-4c4e-a069-67053aeb3cc9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:59.558453 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06fc013b-93b9-4c4e-a069-67053aeb3cc9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:59.558910 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06fc013b-93b9-4c4e-a069-67053aeb3cc9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:59.559682 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06fc013b-93b9-4c4e-a069-67053aeb3cc9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:59.560128 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-06fc013b-93b9-4c4e-a069-67053aeb3cc9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:59.694882 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-06fc013b-93b9-4c4e-a069-67053aeb3cc9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:59.703003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-06fc013b-93b9-4c4e-a069-67053aeb3cc9 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.155832 Jun 22 10:36:59.703570 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 642/1299] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:59 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:00.721316 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-3a356568-99d4-4061-9626-804334bd6d65 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:00.722704 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-3a356568-99d4-4061-9626-804334bd6d65 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:00.728512 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3a356568-99d4-4061-9626-804334bd6d65 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:00.729004 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3a356568-99d4-4061-9626-804334bd6d65 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:00.729781 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3a356568-99d4-4061-9626-804334bd6d65 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:00.730219 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-3a356568-99d4-4061-9626-804334bd6d65 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:00.874149 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-3a356568-99d4-4061-9626-804334bd6d65 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:00.881928 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-3a356568-99d4-4061-9626-804334bd6d65 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.165243 Jun 22 10:37:00.887277 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 658/1300] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:00 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:01.901760 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-73e9d2da-e02d-46a6-a1a0-85f49e9ea72f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:01.902384 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-73e9d2da-e02d-46a6-a1a0-85f49e9ea72f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:01.909439 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-73e9d2da-e02d-46a6-a1a0-85f49e9ea72f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:01.909895 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-73e9d2da-e02d-46a6-a1a0-85f49e9ea72f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:01.910664 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-73e9d2da-e02d-46a6-a1a0-85f49e9ea72f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:01.911102 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-73e9d2da-e02d-46a6-a1a0-85f49e9ea72f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:02.051952 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-73e9d2da-e02d-46a6-a1a0-85f49e9ea72f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:02.059763 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-73e9d2da-e02d-46a6-a1a0-85f49e9ea72f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.163176 Jun 22 10:37:02.060329 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 643/1301] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:01 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:03.076732 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-9907cf75-4a3f-4d4e-a635-cbb9cce949e5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:03.077375 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-9907cf75-4a3f-4d4e-a635-cbb9cce949e5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:03.083929 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9907cf75-4a3f-4d4e-a635-cbb9cce949e5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:03.084378 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9907cf75-4a3f-4d4e-a635-cbb9cce949e5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:03.085183 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9907cf75-4a3f-4d4e-a635-cbb9cce949e5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:03.085620 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-9907cf75-4a3f-4d4e-a635-cbb9cce949e5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:03.217288 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-9907cf75-4a3f-4d4e-a635-cbb9cce949e5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:03.225452 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-9907cf75-4a3f-4d4e-a635-cbb9cce949e5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.152512 Jun 22 10:37:03.226020 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 659/1302] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:03 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:04.242943 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-5cc33bea-7aa0-4bbb-a8bd-d9c91cb92587 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:04.243561 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-5cc33bea-7aa0-4bbb-a8bd-d9c91cb92587 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:04.250242 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5cc33bea-7aa0-4bbb-a8bd-d9c91cb92587 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:04.253671 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5cc33bea-7aa0-4bbb-a8bd-d9c91cb92587 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:04.253671 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5cc33bea-7aa0-4bbb-a8bd-d9c91cb92587 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:04.253671 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-5cc33bea-7aa0-4bbb-a8bd-d9c91cb92587 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:04.387897 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-5cc33bea-7aa0-4bbb-a8bd-d9c91cb92587 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:04.396101 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-5cc33bea-7aa0-4bbb-a8bd-d9c91cb92587 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.157049 Jun 22 10:37:04.396680 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 644/1303] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:04 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:37:05.414275 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-61098ba8-1cb6-4d4f-9502-9e892d377428 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:05.414912 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-61098ba8-1cb6-4d4f-9502-9e892d377428 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:05.423767 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-61098ba8-1cb6-4d4f-9502-9e892d377428 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:05.424499 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-61098ba8-1cb6-4d4f-9502-9e892d377428 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:05.425525 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-61098ba8-1cb6-4d4f-9502-9e892d377428 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:05.425966 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-61098ba8-1cb6-4d4f-9502-9e892d377428 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:05.574136 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-61098ba8-1cb6-4d4f-9502-9e892d377428 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:05.582066 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-61098ba8-1cb6-4d4f-9502-9e892d377428 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.171890 Jun 22 10:37:05.582953 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 660/1304] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:05 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:06.598796 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-03571c14-a352-473c-92ef-3bc087c7a549 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:06.599406 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-03571c14-a352-473c-92ef-3bc087c7a549 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:06.606449 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-03571c14-a352-473c-92ef-3bc087c7a549 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:06.606899 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-03571c14-a352-473c-92ef-3bc087c7a549 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:06.607663 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-03571c14-a352-473c-92ef-3bc087c7a549 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:06.608103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-03571c14-a352-473c-92ef-3bc087c7a549 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:06.742734 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-03571c14-a352-473c-92ef-3bc087c7a549 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:06.751010 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-03571c14-a352-473c-92ef-3bc087c7a549 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.156062 Jun 22 10:37:06.751580 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 645/1305] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:06 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:07.767965 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-65655261-7433-4ed2-88b5-f7c069c4d3b0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:07.768670 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-65655261-7433-4ed2-88b5-f7c069c4d3b0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:07.776079 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-65655261-7433-4ed2-88b5-f7c069c4d3b0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:07.776536 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-65655261-7433-4ed2-88b5-f7c069c4d3b0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:07.777349 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-65655261-7433-4ed2-88b5-f7c069c4d3b0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:07.786508 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-65655261-7433-4ed2-88b5-f7c069c4d3b0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:07.786508 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:07.911546 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-65655261-7433-4ed2-88b5-f7c069c4d3b0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:07.923811 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-65655261-7433-4ed2-88b5-f7c069c4d3b0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.155702 Jun 22 10:37:07.923811 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 661/1306] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:07 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:08.938158 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-dca3dc70-1a31-42db-b1e5-c134693c3ed0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:08.938992 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-dca3dc70-1a31-42db-b1e5-c134693c3ed0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:08.945843 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dca3dc70-1a31-42db-b1e5-c134693c3ed0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:08.946386 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dca3dc70-1a31-42db-b1e5-c134693c3ed0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:08.947274 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dca3dc70-1a31-42db-b1e5-c134693c3ed0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:08.947786 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-dca3dc70-1a31-42db-b1e5-c134693c3ed0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:09.148200 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-dca3dc70-1a31-42db-b1e5-c134693c3ed0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:09.156456 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-dca3dc70-1a31-42db-b1e5-c134693c3ed0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.222194 Jun 22 10:37:09.157060 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 646/1307] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:08 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:10.173571 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-7ff18bde-2444-408b-bdda-85e3fb333e6d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:10.174173 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-7ff18bde-2444-408b-bdda-85e3fb333e6d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:10.181105 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7ff18bde-2444-408b-bdda-85e3fb333e6d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:10.181547 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7ff18bde-2444-408b-bdda-85e3fb333e6d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:10.182303 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7ff18bde-2444-408b-bdda-85e3fb333e6d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:10.182730 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-7ff18bde-2444-408b-bdda-85e3fb333e6d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:10.311578 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-7ff18bde-2444-408b-bdda-85e3fb333e6d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:10.319075 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-7ff18bde-2444-408b-bdda-85e3fb333e6d tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.149358 Jun 22 10:37:10.319650 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 662/1308] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:10 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:11.336435 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-c2a64043-de49-457d-becd-c4cab17a0fb5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:11.337484 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-c2a64043-de49-457d-becd-c4cab17a0fb5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:11.339613 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:11.344984 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c2a64043-de49-457d-becd-c4cab17a0fb5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:11.345445 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c2a64043-de49-457d-becd-c4cab17a0fb5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:11.346231 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c2a64043-de49-457d-becd-c4cab17a0fb5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:11.346674 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-c2a64043-de49-457d-becd-c4cab17a0fb5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:11.349622 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=93 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:11.498306 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-c2a64043-de49-457d-becd-c4cab17a0fb5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:11.506160 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-c2a64043-de49-457d-becd-c4cab17a0fb5 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.173612 Jun 22 10:37:11.506744 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 647/1309] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:11 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:37:12.524174 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-880d16c4-4894-4c0e-8d3c-59bf1e4f7178 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:12.524788 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-880d16c4-4894-4c0e-8d3c-59bf1e4f7178 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:12.527879 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:12.532601 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-880d16c4-4894-4c0e-8d3c-59bf1e4f7178 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:12.540477 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-880d16c4-4894-4c0e-8d3c-59bf1e4f7178 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:12.540477 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-880d16c4-4894-4c0e-8d3c-59bf1e4f7178 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:12.540477 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-880d16c4-4894-4c0e-8d3c-59bf1e4f7178 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:12.663112 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-880d16c4-4894-4c0e-8d3c-59bf1e4f7178 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:12.671020 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-880d16c4-4894-4c0e-8d3c-59bf1e4f7178 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1509 microversion: 2.1 time: 0.150643 Jun 22 10:37:12.671597 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 663/1310] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:12 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:12.687239 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-67a6538d-b040-42a1-90ff-56238da642a1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:37:12.687805 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-67a6538d-b040-42a1-90ff-56238da642a1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:12.694779 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-67a6538d-b040-42a1-90ff-56238da642a1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:12.695219 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-67a6538d-b040-42a1-90ff-56238da642a1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:12.695970 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-67a6538d-b040-42a1-90ff-56238da642a1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:12.696399 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-67a6538d-b040-42a1-90ff-56238da642a1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:13.020745 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-67a6538d-b040-42a1-90ff-56238da642a1 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "POST /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848/action" status: 202 len: 0 microversion: 2.1 time: 0.337206 Jun 22 10:37:13.021583 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 648/1311] 10.222.0.46 () {60 vars in 1277 bytes} [Wed Jun 22 10:37:12 2022] POST /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:37:13.029918 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-6d6261a1-944f-412b-a411-6bb6c5161763 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:13.030536 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-6d6261a1-944f-412b-a411-6bb6c5161763 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:13.036622 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6d6261a1-944f-412b-a411-6bb6c5161763 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:13.037112 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6d6261a1-944f-412b-a411-6bb6c5161763 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:13.037894 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6d6261a1-944f-412b-a411-6bb6c5161763 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:13.038339 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-6d6261a1-944f-412b-a411-6bb6c5161763 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:13.172046 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-6d6261a1-944f-412b-a411-6bb6c5161763 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:13.182330 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-6d6261a1-944f-412b-a411-6bb6c5161763 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1517 microversion: 2.1 time: 0.156155 Jun 22 10:37:13.182994 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 664/1312] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:13 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:14.200289 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9687f804-b7aa-42bd-be8d-ab390da8d23a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:14.200918 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9687f804-b7aa-42bd-be8d-ab390da8d23a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:14.207063 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9687f804-b7aa-42bd-be8d-ab390da8d23a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:14.207504 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9687f804-b7aa-42bd-be8d-ab390da8d23a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:14.208262 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9687f804-b7aa-42bd-be8d-ab390da8d23a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:14.208742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9687f804-b7aa-42bd-be8d-ab390da8d23a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:14.347046 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9687f804-b7aa-42bd-be8d-ab390da8d23a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:14.354792 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9687f804-b7aa-42bd-be8d-ab390da8d23a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1519 microversion: 2.1 time: 0.158758 Jun 22 10:37:14.355377 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 649/1313] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:14 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:15.371621 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-c0f4cbec-71e3-41db-89df-72fddd5e1a6a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:15.372238 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-c0f4cbec-71e3-41db-89df-72fddd5e1a6a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:15.378809 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c0f4cbec-71e3-41db-89df-72fddd5e1a6a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:15.381844 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c0f4cbec-71e3-41db-89df-72fddd5e1a6a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:15.381844 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c0f4cbec-71e3-41db-89df-72fddd5e1a6a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:15.381844 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-c0f4cbec-71e3-41db-89df-72fddd5e1a6a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:15.514457 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-c0f4cbec-71e3-41db-89df-72fddd5e1a6a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:15.521993 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-c0f4cbec-71e3-41db-89df-72fddd5e1a6a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1575 microversion: 2.1 time: 0.154357 Jun 22 10:37:15.522552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 665/1314] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:15 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:16.132888 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [req-3c536537-a411-413a-9c37-5ca225bad098 req-bc6b8099-649d-4936-943a-722b03f608da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b3084b-c1c8-472b-bc95-43167a9de848", "name": "network-vif-unplugged", "status": "completed", "tag": "749b4a33-ce57-4dcc-ab58-cde5de4374a7"}]} {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:37:16.143498 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-3c536537-a411-413a-9c37-5ca225bad098 req-bc6b8099-649d-4936-943a-722b03f608da service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:16.143498 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [req-3c536537-a411-413a-9c37-5ca225bad098 req-bc6b8099-649d-4936-943a-722b03f608da service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:16.154026 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.compute.server_external_events [req-3c536537-a411-413a-9c37-5ca225bad098 req-bc6b8099-649d-4936-943a-722b03f608da service nova] Creating event network-vif-unplugged:749b4a33-ce57-4dcc-ab58-cde5de4374a7 for instance 92b3084b-c1c8-472b-bc95-43167a9de848 on hv-cinder-84327 Jun 22 10:37:16.159153 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [req-3c536537-a411-413a-9c37-5ca225bad098 req-bc6b8099-649d-4936-943a-722b03f608da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030328 Jun 22 10:37:16.159905 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 650/1315] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:37:16.540095 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-15a6842c-ba79-4592-9a9d-778aa9f90e08 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:16.540708 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-15a6842c-ba79-4592-9a9d-778aa9f90e08 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:16.547761 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-15a6842c-ba79-4592-9a9d-778aa9f90e08 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:16.548211 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-15a6842c-ba79-4592-9a9d-778aa9f90e08 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:16.548998 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-15a6842c-ba79-4592-9a9d-778aa9f90e08 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:16.549430 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-15a6842c-ba79-4592-9a9d-778aa9f90e08 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:16.679007 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-15a6842c-ba79-4592-9a9d-778aa9f90e08 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:16.686758 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-15a6842c-ba79-4592-9a9d-778aa9f90e08 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1575 microversion: 2.1 time: 0.150880 Jun 22 10:37:16.687343 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 666/1316] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:16 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:17.704573 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-a2f7c7e6-1e8c-45fb-90e5-9aaf6ddc4288 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:17.705433 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-a2f7c7e6-1e8c-45fb-90e5-9aaf6ddc4288 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:17.711857 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a2f7c7e6-1e8c-45fb-90e5-9aaf6ddc4288 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:17.712304 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a2f7c7e6-1e8c-45fb-90e5-9aaf6ddc4288 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:17.713125 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a2f7c7e6-1e8c-45fb-90e5-9aaf6ddc4288 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:17.713569 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-a2f7c7e6-1e8c-45fb-90e5-9aaf6ddc4288 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:17.846797 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-a2f7c7e6-1e8c-45fb-90e5-9aaf6ddc4288 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:17.854319 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-a2f7c7e6-1e8c-45fb-90e5-9aaf6ddc4288 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1575 microversion: 2.1 time: 0.154494 Jun 22 10:37:17.854889 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 651/1317] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:17 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:18.871921 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-a7680c2e-be33-4089-98d9-77e77c3c37fe tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:18.872538 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-a7680c2e-be33-4089-98d9-77e77c3c37fe tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:18.879078 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a7680c2e-be33-4089-98d9-77e77c3c37fe tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:18.879527 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a7680c2e-be33-4089-98d9-77e77c3c37fe tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:18.880288 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a7680c2e-be33-4089-98d9-77e77c3c37fe tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:18.880723 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-a7680c2e-be33-4089-98d9-77e77c3c37fe tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:19.010010 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-a7680c2e-be33-4089-98d9-77e77c3c37fe tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:19.017920 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-a7680c2e-be33-4089-98d9-77e77c3c37fe tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1575 microversion: 2.1 time: 0.149976 Jun 22 10:37:19.018492 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 667/1318] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:18 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:20.035536 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-380c8972-70a2-4d34-a587-150e5bcfe73e tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:20.036096 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-380c8972-70a2-4d34-a587-150e5bcfe73e tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:20.042704 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-380c8972-70a2-4d34-a587-150e5bcfe73e tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:20.043148 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-380c8972-70a2-4d34-a587-150e5bcfe73e tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:20.044450 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-380c8972-70a2-4d34-a587-150e5bcfe73e tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:20.044920 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-380c8972-70a2-4d34-a587-150e5bcfe73e tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:20.177023 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-380c8972-70a2-4d34-a587-150e5bcfe73e tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:20.184497 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-380c8972-70a2-4d34-a587-150e5bcfe73e tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1575 microversion: 2.1 time: 0.152939 Jun 22 10:37:20.185091 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 652/1319] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:20 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:21.201639 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-879d822b-a753-4508-af24-c78761754f0a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:21.202243 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-879d822b-a753-4508-af24-c78761754f0a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:21.208720 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-879d822b-a753-4508-af24-c78761754f0a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:21.209201 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-879d822b-a753-4508-af24-c78761754f0a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:21.209974 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-879d822b-a753-4508-af24-c78761754f0a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:21.210411 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-879d822b-a753-4508-af24-c78761754f0a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:21.350781 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-879d822b-a753-4508-af24-c78761754f0a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:21.358332 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-879d822b-a753-4508-af24-c78761754f0a tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1575 microversion: 2.1 time: 0.160690 Jun 22 10:37:21.358889 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 668/1320] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:21 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:22.376148 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-4b37d9ba-efb7-4d22-b4c7-4ec0114e9fd6 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:22.376742 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-4b37d9ba-efb7-4d22-b4c7-4ec0114e9fd6 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:22.383415 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4b37d9ba-efb7-4d22-b4c7-4ec0114e9fd6 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:22.383867 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4b37d9ba-efb7-4d22-b4c7-4ec0114e9fd6 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:22.384639 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4b37d9ba-efb7-4d22-b4c7-4ec0114e9fd6 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:22.385103 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-4b37d9ba-efb7-4d22-b4c7-4ec0114e9fd6 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:22.513582 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-4b37d9ba-efb7-4d22-b4c7-4ec0114e9fd6 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:22.521049 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-4b37d9ba-efb7-4d22-b4c7-4ec0114e9fd6 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1575 microversion: 2.1 time: 0.149378 Jun 22 10:37:22.521618 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 653/1321] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:22 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:23.538568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-bbb34708-c494-4613-804e-a691a4ca0e4f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:23.539161 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-bbb34708-c494-4613-804e-a691a4ca0e4f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:23.546311 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bbb34708-c494-4613-804e-a691a4ca0e4f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:23.546761 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bbb34708-c494-4613-804e-a691a4ca0e4f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:23.547516 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bbb34708-c494-4613-804e-a691a4ca0e4f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:23.547948 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-bbb34708-c494-4613-804e-a691a4ca0e4f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:23.679219 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-bbb34708-c494-4613-804e-a691a4ca0e4f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:23.687660 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-bbb34708-c494-4613-804e-a691a4ca0e4f tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1575 microversion: 2.1 time: 0.152941 Jun 22 10:37:23.688240 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 669/1322] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:23 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:24.705626 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-39ee0817-0f16-4267-8b1e-06b5475db631 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:24.706239 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-39ee0817-0f16-4267-8b1e-06b5475db631 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:24.712880 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-39ee0817-0f16-4267-8b1e-06b5475db631 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:24.713332 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-39ee0817-0f16-4267-8b1e-06b5475db631 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:24.714128 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-39ee0817-0f16-4267-8b1e-06b5475db631 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:24.714564 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-39ee0817-0f16-4267-8b1e-06b5475db631 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:24.849700 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-39ee0817-0f16-4267-8b1e-06b5475db631 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:24.857274 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-39ee0817-0f16-4267-8b1e-06b5475db631 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1562 microversion: 2.1 time: 0.156102 Jun 22 10:37:24.857873 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 654/1323] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:24 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:28.262697 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-cf00942b-c0fb-49ca-89ca-9b3f351e1d0d req-9e79dd3f-b1fe-441e-b5c1-aa35433fd95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b3084b-c1c8-472b-bc95-43167a9de848", "name": "network-vif-plugged", "status": "completed", "tag": "749b4a33-ce57-4dcc-ab58-cde5de4374a7"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:37:28.272588 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-cf00942b-c0fb-49ca-89ca-9b3f351e1d0d req-9e79dd3f-b1fe-441e-b5c1-aa35433fd95c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:28.273155 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-cf00942b-c0fb-49ca-89ca-9b3f351e1d0d req-9e79dd3f-b1fe-441e-b5c1-aa35433fd95c service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:28.285444 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-cf00942b-c0fb-49ca-89ca-9b3f351e1d0d req-9e79dd3f-b1fe-441e-b5c1-aa35433fd95c service nova] Creating event network-vif-plugged:749b4a33-ce57-4dcc-ab58-cde5de4374a7 for instance 92b3084b-c1c8-472b-bc95-43167a9de848 on hv-cinder-84327 Jun 22 10:37:28.290552 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-cf00942b-c0fb-49ca-89ca-9b3f351e1d0d req-9e79dd3f-b1fe-441e-b5c1-aa35433fd95c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031891 Jun 22 10:37:28.291523 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 670/1324] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:39:09.273568 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [da345f7e-4da5-436a-b358-6f9d156e2b3e] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 10:39:09.274246 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-b4d7f01a-3fb9-4124-8a05-e56e5cf4b99c tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:39:09.274644 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_api:SELECT=15 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:39:09.274744 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b4d7f01a-3fb9-4124-8a05-e56e5cf4b99c tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:39:09.275180 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG dbcounter [-] [118327] Writing DB stats nova_cell1:SELECT=54 {{(pid=118327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:39:09.277643 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f3bc47cf-d834-40d6-acc3-eed2b7cdfdc6] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 22 10:39:09.278159 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_api:SELECT=17 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:39:09.278825 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG dbcounter [-] [118326] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118326) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:39:09.280500 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-d3d1b013-d4bc-4702-a06b-3841f6cd59ab req-e32ad118-ad8c-4a94-954e-2c25dfa3b20a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b3084b-c1c8-472b-bc95-43167a9de848", "tag": "749b4a33-ce57-4dcc-ab58-cde5de4374a7"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:39:09.284083 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b4d7f01a-3fb9-4124-8a05-e56e5cf4b99c tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:09.284534 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b4d7f01a-3fb9-4124-8a05-e56e5cf4b99c tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:09.285337 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b4d7f01a-3fb9-4124-8a05-e56e5cf4b99c tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:09.285768 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-b4d7f01a-3fb9-4124-8a05-e56e5cf4b99c tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:09.290402 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-d3d1b013-d4bc-4702-a06b-3841f6cd59ab req-e32ad118-ad8c-4a94-954e-2c25dfa3b20a service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:09.290598 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-d3d1b013-d4bc-4702-a06b-3841f6cd59ab req-e32ad118-ad8c-4a94-954e-2c25dfa3b20a service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:09.301986 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-d3d1b013-d4bc-4702-a06b-3841f6cd59ab req-e32ad118-ad8c-4a94-954e-2c25dfa3b20a service nova] Creating event network-changed:749b4a33-ce57-4dcc-ab58-cde5de4374a7 for instance 92b3084b-c1c8-472b-bc95-43167a9de848 on hv-cinder-84327 Jun 22 10:39:09.308317 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-d3d1b013-d4bc-4702-a06b-3841f6cd59ab req-e32ad118-ad8c-4a94-954e-2c25dfa3b20a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036756 Jun 22 10:39:09.309184 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 671/1325] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:39:09.316201 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-b4d7f01a-3fb9-4124-8a05-e56e5cf4b99c tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Going to try to terminate instance {{(pid=118326) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:39:09.675428 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-b4d7f01a-3fb9-4124-8a05-e56e5cf4b99c tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "DELETE /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 204 len: 0 microversion: 2.1 time: 0.406427 Jun 22 10:39:09.676123 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 655/1326] 10.222.0.46 () {58 vars in 1238 bytes} [Wed Jun 22 10:39:09 2022] DELETE /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:39:09.685538 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-82bb6b07-a835-4797-b1f5-7b0047bf9abf tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:39:09.688265 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-82bb6b07-a835-4797-b1f5-7b0047bf9abf tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:39:09.693641 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-82bb6b07-a835-4797-b1f5-7b0047bf9abf tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:09.694751 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-82bb6b07-a835-4797-b1f5-7b0047bf9abf tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:09.695603 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-82bb6b07-a835-4797-b1f5-7b0047bf9abf tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:09.696045 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-82bb6b07-a835-4797-b1f5-7b0047bf9abf tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:09.904113 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-82bb6b07-a835-4797-b1f5-7b0047bf9abf tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:39:09.913090 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-82bb6b07-a835-4797-b1f5-7b0047bf9abf tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1568 microversion: 2.1 time: 0.232428 Jun 22 10:39:09.913792 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 672/1327] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:39:09 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:39:10.931059 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-8b01fc5d-1dd6-401a-b98b-8cbb1fa4b8c4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:39:10.931668 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-8b01fc5d-1dd6-401a-b98b-8cbb1fa4b8c4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:39:10.940019 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8b01fc5d-1dd6-401a-b98b-8cbb1fa4b8c4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:10.940463 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8b01fc5d-1dd6-401a-b98b-8cbb1fa4b8c4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:10.941254 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8b01fc5d-1dd6-401a-b98b-8cbb1fa4b8c4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:10.941684 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-8b01fc5d-1dd6-401a-b98b-8cbb1fa4b8c4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:10.947502 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO oslo.messaging._drivers.impl_rabbit [-] [f3bc47cf-d834-40d6-acc3-eed2b7cdfdc6] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 34166. Jun 22 10:39:11.129454 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-8b01fc5d-1dd6-401a-b98b-8cbb1fa4b8c4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:39:11.137749 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-8b01fc5d-1dd6-401a-b98b-8cbb1fa4b8c4 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1449 microversion: 2.1 time: 0.211071 Jun 22 10:39:11.138315 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 656/1328] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:39:10 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1449 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:39:11.882648 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [req-b8312947-2d00-4f35-8289-2dc7bbdf21f6 req-e50a4952-3ca7-45a5-9fe7-851056742e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b3084b-c1c8-472b-bc95-43167a9de848", "name": "network-vif-deleted", "tag": "749b4a33-ce57-4dcc-ab58-cde5de4374a7"}]} {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:39:11.882648 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-b8312947-2d00-4f35-8289-2dc7bbdf21f6 req-e50a4952-3ca7-45a5-9fe7-851056742e4d service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:11.882648 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [req-b8312947-2d00-4f35-8289-2dc7bbdf21f6 req-e50a4952-3ca7-45a5-9fe7-851056742e4d service nova] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:11.891016 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.compute.server_external_events [req-b8312947-2d00-4f35-8289-2dc7bbdf21f6 req-e50a4952-3ca7-45a5-9fe7-851056742e4d service nova] Creating event network-vif-deleted:749b4a33-ce57-4dcc-ab58-cde5de4374a7 for instance 92b3084b-c1c8-472b-bc95-43167a9de848 on hv-cinder-84327 Jun 22 10:39:11.894633 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO oslo.messaging._drivers.impl_rabbit [-] [da345f7e-4da5-436a-b358-6f9d156e2b3e] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 34172. Jun 22 10:39:11.896239 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [req-b8312947-2d00-4f35-8289-2dc7bbdf21f6 req-e50a4952-3ca7-45a5-9fe7-851056742e4d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034176 Jun 22 10:39:11.896852 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 673/1329] 10.222.0.46 () {64 vars in 1317 bytes} [Wed Jun 22 10:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:39:12.154625 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-9476967b-818e-46c7-8166-f0cf8af12060 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:39:12.155285 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-9476967b-818e-46c7-8166-f0cf8af12060 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:39:12.162027 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9476967b-818e-46c7-8166-f0cf8af12060 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:12.162481 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9476967b-818e-46c7-8166-f0cf8af12060 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:12.163837 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9476967b-818e-46c7-8166-f0cf8af12060 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:12.164305 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-9476967b-818e-46c7-8166-f0cf8af12060 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:12.231667 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.policy [None req-9476967b-818e-46c7-8166-f0cf8af12060 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118326) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:39:12.239953 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-9476967b-818e-46c7-8166-f0cf8af12060 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1219 microversion: 2.1 time: 0.089178 Jun 22 10:39:12.240540 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 657/1330] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:39:12 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:39:13.257383 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-5590c85a-7be0-434a-b490-ab6ef28391ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:39:13.257971 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.compute.api [None req-5590c85a-7be0-434a-b490-ab6ef28391ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118327) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:39:13.264518 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5590c85a-7be0-434a-b490-ab6ef28391ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:13.264984 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5590c85a-7be0-434a-b490-ab6ef28391ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:13.265737 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5590c85a-7be0-434a-b490-ab6ef28391ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:13.266168 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5590c85a-7be0-434a-b490-ab6ef28391ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:13.297548 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5590c85a-7be0-434a-b490-ab6ef28391ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:13.297987 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG oslo_concurrency.lockutils [None req-5590c85a-7be0-434a-b490-ab6ef28391ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:13.298427 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.objects.instance [None req-5590c85a-7be0-434a-b490-ab6ef28391ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lazy-loading 'fault' on Instance uuid 92b3084b-c1c8-472b-bc95-43167a9de848 {{(pid=118327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:39:13.339643 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.policy [None req-5590c85a-7be0-434a-b490-ab6ef28391ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce996aac321f4f39a4fb8bc759020a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed0bebe0a884b0b96282770ef35b22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118327) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:39:13.346813 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-5590c85a-7be0-434a-b490-ab6ef28391ea tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 200 len: 1178 microversion: 2.1 time: 0.093981 Jun 22 10:39:13.347385 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 674/1331] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:39:13 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 1178 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:39:14.363957 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6e74e5f5-cd5e-429b-8b90-0c28e482ada3 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '>' {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:39:14.364586 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.compute.api [None req-6e74e5f5-cd5e-429b-8b90-0c28e482ada3 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] [instance: 92b3084b-c1c8-472b-bc95-43167a9de848] Fetching instance by UUID {{(pid=118326) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:39:14.371557 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6e74e5f5-cd5e-429b-8b90-0c28e482ada3 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:14.372003 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6e74e5f5-cd5e-429b-8b90-0c28e482ada3 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:14.372765 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6e74e5f5-cd5e-429b-8b90-0c28e482ada3 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:39:14.373222 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG oslo_concurrency.lockutils [None req-6e74e5f5-cd5e-429b-8b90-0c28e482ada3 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Lock "3fe4125f-02c9-4f08-8eb6-fd2b104a6fb6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118326) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:39:14.387114 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.wsgi [None req-6e74e5f5-cd5e-429b-8b90-0c28e482ada3 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] HTTP exception thrown: Instance 92b3084b-c1c8-472b-bc95-43167a9de848 could not be found. Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6e74e5f5-cd5e-429b-8b90-0c28e482ada3 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Request method failure captured: Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: request: GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 HTTP/1.1 Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept: application/json Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Accept-Encoding: identity Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Connection: close Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Length: 0 Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Content-Type: application/json Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Host: 10.222.0.46 Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Openstack-System-Scope: None Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: User-Agent: python-urllib3/1.26.9 Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Auth-Token: gAAAAABisvALaUiKjmsryM-5noOr6d8z1B72sEoex4n3sTL7Nst4gYk36eqTSyf5nrOpLa20fuuLGfDwtEpxI5ZV_qO9q93NXUtJAWzmPOD4qBvFYxTPeL_4HnmoMm5sVoCgvOBI3-vZEaPqVk_3WrDVZtZbsY-EOoUgEkqtVTbieZRdG1InNCs Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Id: None Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Domain-Name: None Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Identity-Status: Confirmed Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Is-Admin-Project: True Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Id: default Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Domain-Name: Default Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Id: 7ed0bebe0a884b0b96282770ef35b22e Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Project-Name: tempest-TestShelveInstance-36718439 Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Role: member,reader Jun 22 10:39:14.389066 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Roles: member,reader Jun 22 10:39:14.391441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7ed0bebe0a884b0b96282770ef35b22e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7ed0bebe0a884b0b96282770ef35b22e", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7ed0bebe0a884b0b96282770ef35b22e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7ed0bebe0a884b0b96282770ef35b22e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}] Jun 22 10:39:14.391441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant: tempest-TestShelveInstance-36718439 Jun 22 10:39:14.391441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Id: 7ed0bebe0a884b0b96282770ef35b22e Jun 22 10:39:14.391441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-Tenant-Name: tempest-TestShelveInstance-36718439 Jun 22 10:39:14.391441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User: tempest-TestShelveInstance-36718439-project Jun 22 10:39:14.391441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Id: default Jun 22 10:39:14.391441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Domain-Name: Default Jun 22 10:39:14.391441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Id: ce996aac321f4f39a4fb8bc759020a6d Jun 22 10:39:14.391441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: X-User-Name: tempest-TestShelveInstance-36718439-project Jun 22 10:39:14.391441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: method: > Jun 22 10:39:14.391441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: exception: Instance 92b3084b-c1c8-472b-bc95-43167a9de848 could not be found. Jun 22 10:39:14.391441 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: action_args: {'id': '92b3084b-c1c8-472b-bc95-43167a9de848'} Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: {{(pid=118326) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b3084b-c1c8-472b-bc95-43167a9de848 could not be found. Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:39:14.394389 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b3084b-c1c8-472b-bc95-43167a9de848 could not be found. Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b3084b-c1c8-472b-bc95-43167a9de848 could not be found. Jun 22 10:39:14.397150 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: ERROR nova.api.openstack.wsgi Jun 22 10:39:14.399719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: DEBUG nova.api.openstack.wsgi [None req-6e74e5f5-cd5e-429b-8b90-0c28e482ada3 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Returning 404 to user: Instance 92b3084b-c1c8-472b-bc95-43167a9de848 could not be found. {{(pid=118326) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:39:14.399719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO nova.api.openstack.requestlog [None req-6e74e5f5-cd5e-429b-8b90-0c28e482ada3 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848" status: 404 len: 111 microversion: 2.1 time: 0.030479 Jun 22 10:39:14.399719 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: [pid: 118326|app: 0|req: 658/1332] 10.222.0.46 () {58 vars in 1235 bytes} [Wed Jun 22 10:39:14 2022] GET /compute/v2.1/servers/92b3084b-c1c8-472b-bc95-43167a9de848 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:39:14.605200 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: DEBUG nova.api.openstack.wsgi [None req-ba2eb561-e2b7-4972-afd1-21d1268301d0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] Calling method '.version_select at 0x7f022c061160>' {{(pid=118327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:39:14.687404 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO nova.api.openstack.requestlog [None req-ba2eb561-e2b7-4972-afd1-21d1268301d0 tempest-TestShelveInstance-36718439 tempest-TestShelveInstance-36718439-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1091582237" status: 202 len: 0 microversion: 2.1 time: 0.086106 Jun 22 10:39:14.687990 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: [pid: 118327|app: 0|req: 675/1333] 10.222.0.46 () {58 vars in 1253 bytes} [Wed Jun 22 10:39:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1091582237 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:40:12.177465 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:40:12.178215 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Wed Jun 22 10:40:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:40:15.245384 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:40:15.245982 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Wed Jun 22 10:40:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:40:16.144917 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:40:16.145160 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Wed Jun 22 10:40:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:41:58.025279 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:41:58.025865 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Wed Jun 22 10:41:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:42:11.962000 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:42:11.962661 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Wed Jun 22 10:42:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:42:14.063817 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:42:14.064391 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Wed Jun 22 10:42:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:43:32.185731 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:43:32.186358 dv-cinder-843277-5-iscsi devstack@n-api.service[118327]: Wed Jun 22 10:43:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:43:35.253078 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:43:35.253644 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Wed Jun 22 10:43:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:43:36.152893 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:43:36.153131 dv-cinder-843277-5-iscsi devstack@n-api.service[118326]: Wed Jun 22 10:43:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!